2024-04-26T22:05:20.275 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T22:05:20.275 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253 --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/orig.config.yaml 2024-04-26T22:05:20.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T22:05:20.414 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253 branch: wip-rishabh-testing-20240426.111959 description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} email: null first_in_suite: false job_id: '7675253' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdviHqzHs+vdNmyuFyasvDD/rfZLPuatmIaZogHh2SLOrwEmwQn3LVJ05oVH6D3A/yM6NjqgO+QbuA4ZB220rg= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB1S6+scQRZqt3NL0nI7n8ZTuZbylBMEgqqac11Hxg/27waG8oxqCdTGYejbKyIa/zH124AfkBmcYeZnSh5LIE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T22:05:20.414 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T22:05:20.415 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T22:05:20.415 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T22:05:20.416 INFO:teuthology.task.internal:Checking packages... 2024-04-26T22:05:20.439 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T22:05:20.439 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T22:05:20.439 INFO:teuthology.packaging:ref: None 2024-04-26T22:05:20.439 INFO:teuthology.packaging:tag: None 2024-04-26T22:05:20.439 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T22:05:20.440 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:05:20.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T22:05:20.584 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:05:20.585 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T22:05:20.591 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T22:05:20.591 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T22:05:20.616 INFO:teuthology.task.internal:Saving configuration 2024-04-26T22:05:20.631 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T22:05:20.641 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:05:20.665 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:59:48.280384', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEoVniWCAYk/mD4L3qYWt1FpP+ZR0Wmh85BO9tXp99ct'} 2024-04-26T22:05:20.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:59:48.282430', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPiPcTweP+H3b0P9/sENcn+7SPBx/5wQ1p1OT6J3hpCm'} 2024-04-26T22:05:20.683 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T22:05:20.689 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T22:05:20.689 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T22:05:20.689 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T22:05:20.758 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5992db53a0>, signals=[15]) 2024-04-26T22:05:20.759 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T22:05:20.764 INFO:teuthology.task.internal:Opening connections... 2024-04-26T22:05:20.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:05:20.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:05:20.847 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:05:20.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:05:20.927 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T22:05:20.932 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-26T22:05:20.938 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-26T22:05:20.938 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-26T22:05:20.987 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T22:05:20.988 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-04-26T22:05:20.989 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-26T22:05:21.014 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-26T22:05:21.020 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-26T22:05:21.020 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-26T22:05:21.066 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T22:05:21.067 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2024-04-26T22:05:21.067 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-26T22:05:21.097 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T22:05:21.106 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T22:05:21.112 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T22:05:21.112 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-26T22:05:21.115 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-26T22:05:21.119 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T22:05:21.127 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T22:05:21.127 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-26T22:05:21.161 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-26T22:05:21.177 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T22:05:21.228 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T22:05:21.242 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T22:05:21.243 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T22:05:21.243 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T22:05:21.243 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T22:05:21.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:05:21.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:05:21.248 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T22:05:21.249 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-26T22:05:21.249 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T22:05:21.249 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T22:05:21.295 INFO:teuthology.orchestra.run.smithi195.stdout:5.15.0-56-generic 2024-04-26T22:05:21.295 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.295 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T22:05:21.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.299 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-04-26T22:05:21.299 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.299 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T22:05:21.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:05:21.449 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-26T22:05:21.450 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T22:05:21.463 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T22:05:21.593 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git config --global init.defaultBranch 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: 2024-04-26T22:05:21.594 INFO:teuthology.orchestra.run.smithi195.stderr:hint: git branch -m 2024-04-26T22:05:21.595 INFO:teuthology.orchestra.run.smithi195.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T22:05:21.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T22:05:21.613 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-26T22:05:21.613 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T22:05:21.637 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T22:05:21.663 DEBUG:teuthology.orchestra.run.smithi195:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T22:05:21.721 DEBUG:teuthology.orchestra.run.smithi195:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git config --global init.defaultBranch 2024-04-26T22:05:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T22:05:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T22:05:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T22:05:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-26T22:05:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git branch -m 2024-04-26T22:05:21.777 INFO:teuthology.orchestra.run.smithi016.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T22:05:21.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T22:05:21.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T22:05:21.901 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T22:06:09.556 INFO:teuthology.orchestra.run.smithi195.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T22:06:09.556 INFO:teuthology.orchestra.run.smithi195.stderr: * [new branch] main -> origin/main 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T22:06:09.590 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T22:06:09.591 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T22:06:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T22:06:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T22:06:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T22:06:09.593 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T22:06:09.594 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T22:06:09.595 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T22:06:09.597 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T22:06:09.598 INFO:teuthology.orchestra.run.smithi195.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T22:06:13.396 INFO:teuthology.orchestra.run.smithi016.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T22:06:13.396 INFO:teuthology.orchestra.run.smithi016.stderr: * [new branch] main -> origin/main 2024-04-26T22:06:13.423 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T22:06:13.423 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T22:06:13.423 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T22:06:13.424 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T22:06:13.424 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T22:06:13.424 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T22:06:13.425 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T22:06:13.425 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T22:06:13.426 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T22:06:13.429 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T22:06:13.430 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T22:06:13.431 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T22:06:13.431 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T22:06:13.431 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T22:06:13.431 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T22:06:13.432 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T22:06:13.856 INFO:teuthology.orchestra.run.smithi195.stderr:Updating files: 45% (1538/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2019/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2821/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T22:06:13.861 INFO:teuthology.orchestra.run.smithi195.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T22:06:13.882 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T22:06:13.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:06:14.027 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:14.028 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T22:06:14.030 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-04-26T22:06:16.026 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26 22:06:16 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T22:06:16.026 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2024-04-26 22:06:16-- 2024-04-26T22:06:16.026 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 2.0s 2024-04-26T22:06:16.026 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 43M in 1.8s (23.2 MB/s) 2024-04-26T22:06:16.031 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T22:06:16.031 DEBUG:teuthology.orchestra.run.smithi195:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T22:06:16.335 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T22:06:17.944 INFO:teuthology.orchestra.run.smithi016.stderr:Updating files: 44% (1505/3390) Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 58% (1986/3390) Updating files: 59% (2001/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 68% (2339/3390) Updating files: 69% (2340/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 82% (2790/3390) Updating files: 83% (2814/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T22:06:17.949 INFO:teuthology.orchestra.run.smithi016.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T22:06:17.972 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T22:06:17.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T22:06:18.117 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:18.117 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T22:06:18.120 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-26T22:06:18.385 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T22:06:18.389 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T22:06:18.495 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:06:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26 22:06:21 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T22:06:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2024-04-26 22:06:21-- 2024-04-26T22:06:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 1.8s 2024-04-26T22:06:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 43M in 1.6s (25.9 MB/s) 2024-04-26T22:06:19.996 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T22:06:19.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T22:06:20.277 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T22:06:22.295 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T22:06:22.299 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T22:06:22.369 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:06:22.468 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:06:22.481 INFO:teuthology.orchestra.run.smithi195.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:26.807 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T22:06:26.933 INFO:teuthology.orchestra.run.smithi016.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:44.625 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:06:44.643 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:06:44.668 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-26T22:06:44.972 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:45.000 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:45.284 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:06:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:06:45.364 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:06:45.369 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:06:45.526 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:06:45.526 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:06:45.526 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:06:45.564 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-26T22:06:45.752 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T22:06:45.760 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T22:06:45.760 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T22:06:45.760 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:45.775 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:45.775 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T22:06:45.797 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T22:06:45.798 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T22:06:45.799 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T22:06:45.800 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T22:06:45.873 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T22:06:45.874 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T22:06:45.875 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T22:06:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T22:06:45.877 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T22:06:45.878 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T22:06:45.879 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T22:06:45.880 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T22:06:45.881 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T22:06:45.882 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T22:06:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T22:06:45.884 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T22:06:45.885 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T22:06:45.886 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T22:06:45.887 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T22:06:45.888 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T22:06:45.889 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T22:06:45.890 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T22:06:45.891 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T22:06:45.892 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T22:06:45.893 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T22:06:45.894 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T22:06:45.895 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T22:06:45.896 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T22:06:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T22:06:45.898 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T22:06:45.899 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T22:06:45.900 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T22:06:45.901 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T22:06:45.902 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T22:06:45.903 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T22:06:45.904 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T22:06:45.905 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T22:06:45.906 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T22:06:45.907 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T22:06:45.908 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T22:06:45.909 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T22:06:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T22:06:45.911 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T22:06:45.913 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T22:06:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T22:06:45.915 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T22:06:45.920 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T22:06:45.925 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T22:06:45.926 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T22:06:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T22:06:45.928 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T22:06:45.929 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T22:06:45.930 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T22:06:45.998 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T22:06:45.999 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T22:06:46.000 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T22:06:46.001 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T22:06:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T22:06:46.003 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T22:06:46.004 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T22:06:46.005 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T22:06:46.006 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T22:06:46.007 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T22:06:46.008 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T22:06:46.009 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T22:06:46.010 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T22:06:46.011 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T22:06:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T22:06:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T22:06:46.014 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T22:06:46.015 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T22:06:46.016 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T22:06:46.017 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T22:06:46.018 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T22:06:46.019 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T22:06:46.020 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T22:06:46.021 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T22:06:46.022 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T22:06:46.023 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T22:06:46.024 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T22:06:46.025 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T22:06:46.026 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T22:06:46.027 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T22:06:46.028 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T22:06:46.029 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T22:06:46.030 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T22:06:46.031 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T22:06:46.032 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T22:06:46.033 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T22:06:46.034 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T22:06:46.035 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T22:06:46.036 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T22:06:46.037 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T22:06:46.038 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T22:06:46.039 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T22:06:46.040 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T22:06:46.041 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T22:06:46.042 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T22:06:46.043 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T22:06:46.044 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T22:06:46.045 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T22:06:46.046 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T22:06:46.047 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T22:06:46.048 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T22:06:46.049 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T22:06:46.050 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T22:06:46.051 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T22:06:46.052 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T22:06:46.053 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T22:06:46.054 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T22:06:46.055 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T22:06:46.056 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T22:06:46.057 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T22:06:46.058 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T22:06:46.102 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T22:06:46.103 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T22:06:46.104 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T22:06:46.105 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T22:06:46.106 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T22:06:46.107 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T22:06:46.108 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T22:06:46.109 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T22:06:46.110 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T22:06:46.111 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T22:06:46.112 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T22:06:46.113 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T22:06:46.114 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T22:06:46.115 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T22:06:46.116 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T22:06:46.117 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T22:06:46.118 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T22:06:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T22:06:46.120 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T22:06:46.121 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T22:06:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T22:06:46.123 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T22:06:46.124 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T22:06:46.125 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T22:06:46.126 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T22:06:46.127 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T22:06:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T22:06:46.129 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T22:06:46.130 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T22:06:46.131 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T22:06:46.132 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T22:06:46.133 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T22:06:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T22:06:46.135 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T22:06:46.136 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T22:06:46.137 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T22:06:46.138 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T22:06:46.139 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T22:06:46.140 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T22:06:46.141 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T22:06:46.142 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T22:06:46.143 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T22:06:46.144 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T22:06:46.145 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T22:06:46.150 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:46.150 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:46.150 DEBUG:teuthology.orchestra.run.smithi195:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T22:06:46.157 INFO:teuthology.orchestra.run.smithi195.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:46.157 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:46.157 INFO:teuthology.orchestra.run.smithi195.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:46.158 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T22:06:46.158 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:46.158 DEBUG:teuthology.orchestra.run.smithi195:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T22:06:46.199 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi195.front.sepia.ceph.com to complete... 2024-04-26T22:06:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:06:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:06:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-26T22:06:46.816 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:46.822 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:47.033 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:06:47.039 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:06:47.077 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:06:47.081 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:06:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:06:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:06:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:06:47.231 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-26T22:06:48.402 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-26T22:06:49.749 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:06:49.772 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:06:49.790 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T22:06:50.141 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:50.164 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:50.504 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:06:50.514 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:06:50.578 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:06:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:06:50.745 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:06:50.745 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:06:50.745 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:06:50.777 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T22:06:50.997 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T22:06:51.046 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T22:06:51.046 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T22:06:51.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.065 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.065 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T22:06:51.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T22:06:51.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T22:06:51.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T22:06:51.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T22:06:51.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T22:06:51.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T22:06:51.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T22:06:51.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T22:06:51.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T22:06:51.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T22:06:51.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T22:06:51.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T22:06:51.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T22:06:51.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T22:06:51.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T22:06:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T22:06:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T22:06:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T22:06:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T22:06:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T22:06:51.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T22:06:51.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T22:06:51.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T22:06:51.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T22:06:51.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T22:06:51.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T22:06:51.180 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T22:06:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T22:06:51.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T22:06:51.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T22:06:51.184 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T22:06:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T22:06:51.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T22:06:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T22:06:51.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T22:06:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T22:06:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T22:06:51.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T22:06:51.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T22:06:51.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T22:06:51.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T22:06:51.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T22:06:51.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T22:06:51.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T22:06:51.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T22:06:51.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T22:06:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T22:06:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T22:06:51.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T22:06:51.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T22:06:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T22:06:51.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T22:06:51.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T22:06:51.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T22:06:51.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T22:06:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T22:06:51.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T22:06:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T22:06:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T22:06:51.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T22:06:51.214 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T22:06:51.215 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T22:06:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T22:06:51.217 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T22:06:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T22:06:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T22:06:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T22:06:51.221 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T22:06:51.222 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T22:06:51.223 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T22:06:51.224 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T22:06:51.225 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T22:06:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T22:06:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T22:06:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T22:06:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T22:06:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T22:06:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T22:06:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T22:06:51.271 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T22:06:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T22:06:51.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T22:06:51.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T22:06:51.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T22:06:51.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T22:06:51.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T22:06:51.278 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T22:06:51.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T22:06:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T22:06:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T22:06:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T22:06:51.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T22:06:51.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T22:06:51.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T22:06:51.286 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T22:06:51.287 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T22:06:51.288 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T22:06:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T22:06:51.290 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T22:06:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T22:06:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T22:06:51.293 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T22:06:51.294 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T22:06:51.295 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T22:06:51.296 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T22:06:51.297 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T22:06:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T22:06:51.299 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T22:06:51.300 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T22:06:51.301 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T22:06:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T22:06:51.303 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T22:06:51.304 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T22:06:51.305 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T22:06:51.306 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T22:06:51.307 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T22:06:51.308 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T22:06:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T22:06:51.310 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T22:06:51.311 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T22:06:51.312 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T22:06:51.313 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T22:06:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T22:06:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T22:06:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T22:06:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T22:06:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T22:06:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T22:06:51.357 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T22:06:51.358 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T22:06:51.359 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T22:06:51.360 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T22:06:51.361 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T22:06:51.362 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T22:06:51.363 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T22:06:51.364 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T22:06:51.365 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T22:06:51.366 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T22:06:51.367 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T22:06:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T22:06:51.369 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T22:06:51.370 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T22:06:51.371 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T22:06:51.372 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T22:06:51.373 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T22:06:51.374 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T22:06:51.375 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T22:06:51.376 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T22:06:51.377 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T22:06:51.378 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T22:06:51.379 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T22:06:51.380 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T22:06:51.381 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T22:06:51.382 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T22:06:51.383 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T22:06:51.384 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T22:06:51.385 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T22:06:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T22:06:51.387 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T22:06:51.388 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T22:06:51.389 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T22:06:51.390 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T22:06:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T22:06:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T22:06:51.393 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T22:06:51.394 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T22:06:51.395 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T22:06:51.396 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T22:06:51.397 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T22:06:51.398 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T22:06:51.399 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T22:06:51.400 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T22:06:51.400 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T22:06:51.438 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T22:06:51.439 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T22:06:51.440 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T22:06:51.441 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T22:06:51.442 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T22:06:51.443 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T22:06:51.444 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T22:06:51.445 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T22:06:51.446 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T22:06:51.447 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T22:06:51.448 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T22:06:51.449 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T22:06:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T22:06:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T22:06:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T22:06:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T22:06:51.454 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T22:06:51.455 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T22:06:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T22:06:51.457 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T22:06:51.458 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T22:06:51.459 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T22:06:51.460 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T22:06:51.461 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T22:06:51.462 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T22:06:51.463 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T22:06:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T22:06:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T22:06:51.466 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T22:06:51.467 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T22:06:51.468 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T22:06:51.469 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T22:06:51.470 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T22:06:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T22:06:51.472 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T22:06:51.473 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T22:06:51.474 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T22:06:51.475 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T22:06:51.476 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T22:06:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T22:06:51.478 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T22:06:51.479 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T22:06:51.480 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T22:06:51.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T22:06:51.480 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T22:06:51.484 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.484 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.484 DEBUG:teuthology.orchestra.run.smithi016:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T22:06:51.491 INFO:teuthology.orchestra.run.smithi016.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:51.491 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T22:06:51.492 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T22:06:51.492 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:51.492 DEBUG:teuthology.orchestra.run.smithi016:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T22:06:51.536 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-26T22:06:51.970 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-26T22:06:51.970 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T22:06:51.975 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T22:06:52.200 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:52.207 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T22:06:52.481 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T22:06:52.486 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T22:06:52.530 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T22:06:52.536 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T22:06:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T22:06:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T22:06:52.708 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T22:06:52.729 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T22:07:18.426 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T22:07:18.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T22:07:18.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:07:23.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T22:07:23.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T22:07:23.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:08:18.483 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T22:08:23.850 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T22:08:27.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T22:08:27.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:08:27.959 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-26T22:08:28.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T22:08:28.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T22:08:28.908 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-26T22:08:28.958 INFO:teuthology.orchestra.run.smithi195.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T22:08:28.959 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T22:08:28.959 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T22:08:28.959 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T22:08:29.959 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T22:08:29.960 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T22:08:30.137 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-04-26T22:08:30.205 DEBUG:teuthology.parallel:result is None 2024-04-26T22:08:32.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T22:08:32.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:08:48.477 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T22:08:49.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T22:08:49.492 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T22:08:49.492 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T22:08:49.541 INFO:teuthology.orchestra.run.smithi016.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T22:08:49.541 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T22:08:49.541 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T22:08:49.541 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T22:08:50.542 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T22:08:50.542 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T22:08:50.612 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-04-26T22:08:50.679 DEBUG:teuthology.parallel:result is None 2024-04-26T22:08:50.679 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T22:08:50.695 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T22:08:50.695 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T22:08:50.698 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T22:08:50.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T22:08:50.738 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T22:08:50.748 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T22:08:50.748 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T22:08:50.752 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T22:08:50.798 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T22:08:50.804 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T22:08:50.805 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T22:08:50.816 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T22:08:50.849 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:08:50.860 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:08:50.863 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:08:50.874 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T22:08:50.876 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T22:08:50.909 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T22:08:50.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T22:08:50.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T22:08:50.940 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T22:08:50.948 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T22:08:50.949 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T22:08:50.979 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T22:08:50.991 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T22:08:51.038 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T22:08:51.089 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:08:51.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T22:08:51.164 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T22:08:51.172 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T22:08:51.224 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:08:51.224 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T22:08:51.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-26T22:08:51.300 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-26T22:08:51.413 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T22:08:51.423 INFO:teuthology.task.internal:Starting timer... 2024-04-26T22:08:51.423 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T22:08:51.456 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T22:08:51.469 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-04-26T22:08:51.469 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2024-04-26T22:08:51.469 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T22:08:51.469 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T22:08:51.469 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T22:08:51.470 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T22:08:51.561 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T22:08:51.567 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T22:08:51.700 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T22:08:51.716 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T22:08:51.717 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T22:17:23.994 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-26T22:17:23.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T22:17:23.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:17:24.080 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T22:17:24.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T22:17:24.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T22:17:24.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T22:17:24.276 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-26T22:17:24.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T22:17:24.389 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T22:17:24.401 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T22:17:24.401 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T22:17:24.402 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:17:24.404 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T22:17:24.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:17:24.441 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T22:17:24.441 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Command line: ntpd -gq 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: ---------------------------------------------------- 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: corporation. Support and training for ntp-4 are 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: available at https://www.nwtime.org/support 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: ---------------------------------------------------- 2024-04-26T22:17:24.442 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: proto: precision = 0.045 usec (-24) 2024-04-26T22:17:24.443 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: basedate set to 2022-02-04 2024-04-26T22:17:24.443 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: gps base set to 2022-02-06 (week 2196) 2024-04-26T22:17:24.443 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T22:17:24.443 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T22:17:24.443 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T22:17:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen normally on 4 lo [::1]:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-04-26T22:17:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:24 ntpd[17113]: Listening on routing socket on fd #22 for interface updates 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Command line: ntpd -gq 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: ---------------------------------------------------- 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: corporation. Support and training for ntp-4 are 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: available at https://www.nwtime.org/support 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: ---------------------------------------------------- 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: proto: precision = 0.042 usec (-24) 2024-04-26T22:17:24.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: basedate set to 2022-02-04 2024-04-26T22:17:24.471 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: gps base set to 2022-02-06 (week 2196) 2024-04-26T22:17:24.471 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T22:17:24.471 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T22:17:24.471 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen normally on 4 lo [::1]:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2024-04-26T22:17:24.472 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:24 ntpd[17235]: Listening on routing socket on fd #22 for interface updates 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:25.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:25.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:25 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:25.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:25.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:25 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:26 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:27 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:27.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:27.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:27.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:27.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:27 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:28 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:28.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:28.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:28.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:28.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:28.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:28 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:29.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:29 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:29.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:29.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:29.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:29.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:29 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:30.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:30 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:30.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:30.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:30.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:30.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:30.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:30 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:31.442 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 22:17:31 ntpd[17113]: ntpd: time slew +0.003006 s 2024-04-26T22:17:31.443 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew +0.003006s 2024-04-26T22:17:31.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T22:17:31.444 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 22:17:31 ntpd[17113]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T22:17:31.469 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stdout:26 Apr 22:17:31 ntpd[17235]: ntpd: time slew -0.003848 s 2024-04-26T22:17:31.470 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew -0.003848s 2024-04-26T22:17:31.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T22:17:31.471 INFO:teuthology.orchestra.run.smithi195.stderr:26 Apr 22:17:31 ntpd[17235]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T22:17:31.528 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T22:17:31.528 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T22:17:31.528 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.528 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.528 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.529 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.593 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T22:17:31.593 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-04-26T22:17:31.593 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.593 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.593 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.594 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:17:31.595 INFO:teuthology.run_tasks:Running task install... 2024-04-26T22:17:31.604 DEBUG:teuthology.task.install:project ceph 2024-04-26T22:17:31.604 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T22:17:31.604 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T22:17:31.604 INFO:teuthology.task.install:Using flavor: default 2024-04-26T22:17:31.609 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T22:17:31.609 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T22:17:31.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-04-26T22:17:31.610 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2024-04-26T22:17:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T22:17:31.742 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T22:17:31.769 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T22:17:31.769 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T22:17:31.770 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T22:17:31.770 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T22:17:31.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:17:31.793 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T22:17:31.794 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T22:17:31.794 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T22:17:31.795 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T22:17:31.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:17:31.924 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T22:17:31.924 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:17:32.009 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T22:17:32.010 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:17:32.102 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:17:32.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T22:17:32.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-26T22:17:32.189 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:17:32.189 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T22:17:32.208 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-04-26T22:17:32.318 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T22:17:32.359 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T22:17:32.380 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T22:17:32.402 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T22:17:32.423 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T22:17:32.435 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T22:17:32.456 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T22:17:32.467 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T22:17:32.467 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T22:17:32.507 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T22:17:32.509 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T22:17:32.556 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T22:17:32.595 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T22:17:32.637 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T22:17:32.688 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T22:17:32.727 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T22:17:32.769 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T22:17:32.873 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T22:17:32.928 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 29.2 kB in 1s (50.4 kB/s) 2024-04-26T22:17:33.053 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 29.2 kB in 1s (47.0 kB/s) 2024-04-26T22:17:33.954 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T22:17:33.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:17:34.038 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-04-26T22:17:34.045 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T22:17:34.052 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:17:34.126 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-04-26T22:17:34.224 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T22:17:34.224 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T22:17:34.302 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-04-26T22:17:34.302 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-04-26T22:17:34.407 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T22:17:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T22:17:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T22:17:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T22:17:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T22:17:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T22:17:34.408 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T22:17:34.410 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T22:17:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T22:17:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T22:17:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T22:17:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T22:17:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T22:17:34.412 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-26T22:17:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T22:17:34.481 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T22:17:34.482 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T22:17:34.482 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-04-26T22:17:34.482 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T22:17:34.483 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T22:17:34.483 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T22:17:34.483 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T22:17:34.484 INFO:teuthology.orchestra.run.smithi195.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T22:17:34.485 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-04-26T22:17:34.486 INFO:teuthology.orchestra.run.smithi195.stdout: btrfs-tools 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T22:17:34.567 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T22:17:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T22:17:34.568 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T22:17:34.569 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T22:17:34.570 INFO:teuthology.orchestra.run.smithi016.stdout: socat unzip xmlstarlet zip 2024-04-26T22:17:34.633 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-04-26T22:17:34.634 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T22:17:34.634 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T22:17:34.634 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T22:17:34.634 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T22:17:34.635 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T22:17:34.635 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T22:17:34.636 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T22:17:34.637 INFO:teuthology.orchestra.run.smithi195.stdout: socat unzip xmlstarlet zip 2024-04-26T22:17:34.698 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T22:17:34.698 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 182 MB of archives. 2024-04-26T22:17:34.698 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T22:17:34.698 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T22:17:34.750 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T22:17:34.773 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T22:17:34.773 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 182 MB of archives. 2024-04-26T22:17:34.773 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T22:17:34.773 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T22:17:34.775 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T22:17:34.784 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T22:17:34.824 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T22:17:34.849 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T22:17:34.916 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T22:17:34.969 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T22:17:34.977 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T22:17:34.989 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T22:17:34.993 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T22:17:35.016 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T22:17:35.022 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T22:17:35.055 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T22:17:35.062 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T22:17:35.106 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T22:17:35.113 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T22:17:35.135 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T22:17:35.146 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T22:17:35.148 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T22:17:35.153 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T22:17:35.156 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T22:17:35.165 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T22:17:35.168 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T22:17:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T22:17:35.194 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T22:17:35.201 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T22:17:35.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T22:17:35.233 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T22:17:35.236 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T22:17:35.237 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T22:17:35.239 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T22:17:35.241 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T22:17:35.241 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T22:17:35.242 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T22:17:35.268 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T22:17:35.272 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T22:17:35.273 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T22:17:35.277 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T22:17:35.332 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T22:17:35.337 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T22:17:35.339 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T22:17:35.341 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T22:17:35.342 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T22:17:35.342 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T22:17:35.344 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T22:17:35.347 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T22:17:35.348 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T22:17:35.349 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T22:17:35.350 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T22:17:35.350 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T22:17:35.351 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T22:17:35.351 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T22:17:35.352 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T22:17:35.353 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T22:17:35.355 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T22:17:35.356 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T22:17:35.357 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T22:17:35.359 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T22:17:35.378 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T22:17:35.385 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T22:17:35.386 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T22:17:35.386 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T22:17:35.387 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T22:17:35.387 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T22:17:35.388 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T22:17:35.388 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T22:17:35.388 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T22:17:35.389 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T22:17:35.389 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T22:17:35.389 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T22:17:35.389 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T22:17:35.390 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T22:17:35.390 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T22:17:35.391 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T22:17:35.392 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T22:17:35.393 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T22:17:35.403 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T22:17:35.404 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T22:17:35.420 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T22:17:35.426 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T22:17:35.430 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T22:17:35.431 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T22:17:35.431 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T22:17:35.432 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T22:17:35.432 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T22:17:35.433 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T22:17:35.437 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T22:17:35.438 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T22:17:35.439 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T22:17:35.439 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T22:17:35.440 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T22:17:35.442 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T22:17:35.443 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T22:17:35.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T22:17:35.478 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T22:17:35.479 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T22:17:35.479 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T22:17:35.484 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T22:17:35.484 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T22:17:35.489 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T22:17:35.495 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T22:17:35.495 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T22:17:35.496 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T22:17:35.499 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T22:17:35.526 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T22:17:35.526 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T22:17:35.528 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T22:17:35.531 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T22:17:35.531 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T22:17:35.560 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T22:17:35.561 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T22:17:35.561 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T22:17:35.562 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T22:17:35.562 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T22:17:35.563 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T22:17:35.564 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T22:17:35.564 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T22:17:35.565 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T22:17:35.566 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T22:17:35.592 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T22:17:35.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T22:17:35.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T22:17:35.606 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T22:17:35.634 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T22:17:35.635 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T22:17:35.636 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T22:17:35.673 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T22:17:35.674 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T22:17:35.675 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T22:17:35.676 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T22:17:35.676 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T22:17:35.680 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T22:17:35.698 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T22:17:35.699 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T22:17:35.703 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T22:17:35.703 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T22:17:35.704 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T22:17:35.728 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T22:17:35.730 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T22:17:35.731 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T22:17:35.737 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T22:17:35.742 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T22:17:35.781 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T22:17:35.782 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T22:17:35.783 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T22:17:35.784 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T22:17:35.789 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T22:17:35.789 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T22:17:35.803 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T22:17:35.803 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T22:17:35.812 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T22:17:35.812 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T22:17:35.813 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T22:17:35.814 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T22:17:35.821 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T22:17:35.821 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T22:17:35.822 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T22:17:35.822 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T22:17:35.823 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T22:17:35.824 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T22:17:35.824 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T22:17:35.827 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T22:17:35.834 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T22:17:35.835 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T22:17:35.845 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T22:17:35.846 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T22:17:35.846 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T22:17:35.849 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T22:17:35.854 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T22:17:35.856 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T22:17:35.858 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T22:17:35.859 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T22:17:35.864 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T22:17:35.867 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T22:17:35.868 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T22:17:35.869 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T22:17:35.870 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T22:17:35.874 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T22:17:35.908 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T22:17:35.909 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T22:17:35.942 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T22:17:35.942 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T22:17:35.943 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T22:17:35.943 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T22:17:35.946 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T22:17:35.947 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T22:17:35.958 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T22:17:35.958 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T22:17:35.980 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T22:17:35.984 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T22:17:36.017 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T22:17:36.307 INFO:teuthology.orchestra.run.smithi195.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T22:17:36.476 INFO:teuthology.orchestra.run.smithi195.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T22:17:36.485 INFO:teuthology.orchestra.run.smithi195.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T22:17:36.489 INFO:teuthology.orchestra.run.smithi195.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T22:17:36.542 INFO:teuthology.orchestra.run.smithi195.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T22:17:36.765 INFO:teuthology.orchestra.run.smithi195.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T22:17:37.429 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T22:17:37.590 INFO:teuthology.orchestra.run.smithi195.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T22:17:37.591 INFO:teuthology.orchestra.run.smithi195.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T22:17:37.612 INFO:teuthology.orchestra.run.smithi195.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T22:17:37.704 INFO:teuthology.orchestra.run.smithi195.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T22:17:37.736 INFO:teuthology.orchestra.run.smithi195.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T22:17:37.740 INFO:teuthology.orchestra.run.smithi195.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T22:17:37.826 INFO:teuthology.orchestra.run.smithi195.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T22:17:38.155 INFO:teuthology.orchestra.run.smithi195.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T22:17:38.155 INFO:teuthology.orchestra.run.smithi195.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T22:17:38.253 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T22:17:38.387 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T22:17:38.457 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T22:17:38.465 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T22:17:38.509 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T22:17:38.520 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T22:17:38.589 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T22:17:39.537 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T22:17:39.548 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T22:17:39.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T22:17:40.534 INFO:teuthology.orchestra.run.smithi195.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T22:17:40.535 INFO:teuthology.orchestra.run.smithi195.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T22:17:40.539 INFO:teuthology.orchestra.run.smithi195.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T22:17:40.539 INFO:teuthology.orchestra.run.smithi195.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T22:17:40.542 INFO:teuthology.orchestra.run.smithi195.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T22:17:40.544 INFO:teuthology.orchestra.run.smithi195.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T22:17:41.307 INFO:teuthology.orchestra.run.smithi195.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T22:17:41.572 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T22:17:41.756 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T22:17:41.758 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T22:17:41.762 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T22:17:41.824 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T22:17:41.945 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 182 MB in 7s (27.3 MB/s) 2024-04-26T22:17:42.045 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T22:17:42.121 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T22:17:42.187 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T22:17:42.190 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T22:17:42.235 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T22:17:42.571 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T22:17:42.585 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T22:17:42.630 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T22:17:42.809 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T22:17:42.810 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T22:17:42.831 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T22:17:42.918 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T22:17:42.938 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T22:17:42.941 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T22:17:43.023 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T22:17:43.132 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T22:17:43.146 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T22:17:43.191 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T22:17:43.304 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T22:17:43.304 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T22:17:43.561 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T22:17:43.574 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T22:17:43.669 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T22:17:44.098 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T22:17:44.112 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T22:17:44.164 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T22:17:44.576 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T22:17:44.591 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T22:17:44.642 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T22:17:45.011 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T22:17:45.012 INFO:teuthology.orchestra.run.smithi016.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T22:17:45.014 INFO:teuthology.orchestra.run.smithi016.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T22:17:45.015 INFO:teuthology.orchestra.run.smithi016.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T22:17:45.015 INFO:teuthology.orchestra.run.smithi016.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T22:17:45.016 INFO:teuthology.orchestra.run.smithi016.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T22:17:45.113 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T22:17:45.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:45.179 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:45.465 INFO:teuthology.orchestra.run.smithi016.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T22:17:45.641 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T22:17:45.655 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:45.707 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:46.119 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T22:17:46.125 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 182 MB in 11s (16.7 MB/s) 2024-04-26T22:17:46.134 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:46.185 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:46.286 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T22:17:46.355 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T22:17:46.359 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T22:17:46.410 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T22:17:46.522 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T22:17:46.537 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T22:17:46.580 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T22:17:46.763 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T22:17:46.777 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T22:17:46.829 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T22:17:47.158 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librados2. 2024-04-26T22:17:47.173 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:47.224 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:47.224 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T22:17:47.239 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T22:17:47.291 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T22:17:47.652 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T22:17:47.667 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T22:17:47.719 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librbd1. 2024-04-26T22:17:47.733 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:47.744 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T22:17:47.786 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:48.048 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T22:17:48.063 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T22:17:48.098 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T22:17:48.272 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T22:17:48.286 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:48.355 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:48.434 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T22:17:48.450 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T22:17:48.493 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T22:17:48.657 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rados. 2024-04-26T22:17:48.672 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:48.724 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:48.938 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T22:17:48.953 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:49.004 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:49.118 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T22:17:49.134 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:17:49.185 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:49.408 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T22:17:49.423 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:49.466 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:49.487 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T22:17:49.503 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:49.554 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:49.794 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T22:17:49.810 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T22:17:49.844 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:17:49.915 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T22:17:49.930 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:17:49.973 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:50.181 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T22:17:50.195 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T22:17:50.239 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T22:17:50.335 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T22:17:50.349 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T22:17:50.393 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T22:17:50.592 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-04-26T22:17:50.607 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:50.650 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:50.704 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T22:17:50.718 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:50.771 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:51.053 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-04-26T22:17:51.070 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:51.103 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:51.190 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T22:17:51.205 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T22:17:51.257 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T22:17:51.456 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T22:17:51.471 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:51.514 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:51.526 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T22:17:51.540 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T22:17:51.584 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T22:17:51.809 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-04-26T22:17:51.824 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:51.867 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:52.046 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T22:17:52.060 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T22:17:52.104 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T22:17:52.195 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T22:17:52.210 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:17:52.253 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:52.399 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua5.1. 2024-04-26T22:17:52.414 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T22:17:52.448 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T22:17:52.751 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-any. 2024-04-26T22:17:52.766 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T22:17:52.818 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T22:17:52.915 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T22:17:52.930 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:52.964 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:53.079 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package zip. 2024-04-26T22:17:53.094 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T22:17:53.138 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T22:17:53.301 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T22:17:53.317 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:17:53.359 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:53.433 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package unzip. 2024-04-26T22:17:53.447 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T22:17:53.482 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T22:17:53.687 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T22:17:53.703 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T22:17:53.746 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T22:17:53.853 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package luarocks. 2024-04-26T22:17:53.868 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T22:17:53.911 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T22:17:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T22:17:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:54.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:54.302 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2024-04-26T22:17:54.316 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:54.368 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T22:17:54.368 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:54.384 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T22:17:54.418 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T22:17:54.671 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T22:17:54.686 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T22:17:54.729 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T22:17:54.871 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T22:17:54.886 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:54.929 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:55.024 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T22:17:55.039 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T22:17:55.082 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T22:17:55.274 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T22:17:55.289 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T22:17:55.324 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T22:17:55.402 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-04-26T22:17:55.418 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T22:17:55.452 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T22:17:55.576 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T22:17:55.591 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:55.635 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:55.764 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-04-26T22:17:55.779 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T22:17:55.822 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T22:17:56.058 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-04-26T22:17:56.072 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2024-04-26T22:17:56.074 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T22:17:56.086 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:56.116 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T22:17:56.129 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:56.411 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-04-26T22:17:56.427 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T22:17:56.469 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T22:17:56.848 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-04-26T22:17:56.864 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T22:17:56.898 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T22:17:57.298 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-04-26T22:17:57.312 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:57.356 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:57.428 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2024-04-26T22:17:57.442 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:57.494 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:57.826 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T22:17:57.845 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:58.034 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:58.047 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T22:17:58.061 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T22:17:58.097 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T22:17:58.367 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T22:17:58.370 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T22:17:58.380 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T22:17:58.386 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T22:17:58.420 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T22:17:58.425 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T22:17:58.723 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T22:17:58.739 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:58.745 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T22:17:58.758 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T22:17:58.781 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:58.803 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T22:17:59.106 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T22:17:59.119 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T22:17:59.164 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T22:17:59.210 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-04-26T22:17:59.226 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:17:59.268 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:17:59.467 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T22:17:59.481 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T22:17:59.517 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T22:17:59.795 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T22:17:59.809 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T22:17:59.853 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T22:18:00.189 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-portend. 2024-04-26T22:18:00.204 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T22:18:00.256 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T22:18:00.324 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-04-26T22:18:00.339 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:00.382 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:00.617 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T22:18:00.632 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T22:18:00.675 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T22:18:00.920 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T22:18:00.934 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T22:18:00.969 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T22:18:01.012 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T22:18:01.027 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T22:18:01.070 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T22:18:01.272 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T22:18:01.288 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T22:18:01.331 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T22:18:01.390 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T22:18:01.405 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T22:18:01.448 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T22:18:01.651 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T22:18:01.666 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T22:18:01.701 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T22:18:01.709 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T22:18:01.715 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T22:18:01.751 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T22:18:02.012 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T22:18:02.027 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T22:18:02.054 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T22:18:02.069 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T22:18:02.070 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T22:18:02.112 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T22:18:02.340 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T22:18:02.355 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T22:18:02.390 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T22:18:02.398 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-mako. 2024-04-26T22:18:02.413 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T22:18:02.482 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T22:18:02.693 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T22:18:02.709 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T22:18:02.751 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T22:18:02.810 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T22:18:02.825 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T22:18:02.868 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T22:18:03.054 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-04-26T22:18:03.070 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T22:18:03.112 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T22:18:03.113 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T22:18:03.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T22:18:03.162 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T22:18:03.382 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T22:18:03.398 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T22:18:03.432 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T22:18:03.465 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webob. 2024-04-26T22:18:03.480 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T22:18:03.524 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T22:18:03.720 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T22:18:03.737 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T22:18:03.779 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T22:18:03.868 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T22:18:03.883 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T22:18:03.929 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T22:18:04.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T22:18:04.106 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T22:18:04.140 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T22:18:04.221 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T22:18:04.236 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T22:18:04.271 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T22:18:04.435 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T22:18:04.450 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T22:18:04.493 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T22:18:04.515 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-paste. 2024-04-26T22:18:04.531 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T22:18:04.565 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T22:18:04.780 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T22:18:04.795 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T22:18:04.838 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T22:18:04.868 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T22:18:04.883 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T22:18:04.927 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T22:18:05.141 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-04-26T22:18:05.156 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T22:18:05.199 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T22:18:05.240 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T22:18:05.254 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T22:18:05.298 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T22:18:05.527 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T22:18:05.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T22:18:05.594 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T22:18:05.643 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T22:18:05.658 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T22:18:05.701 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T22:18:05.847 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T22:18:05.862 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T22:18:05.905 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T22:18:06.004 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T22:18:06.019 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T22:18:06.054 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T22:18:06.193 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-04-26T22:18:06.206 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T22:18:06.249 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T22:18:06.400 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T22:18:06.414 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T22:18:06.459 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T22:18:06.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T22:18:06.609 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T22:18:06.655 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T22:18:06.745 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-idna. 2024-04-26T22:18:06.759 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T22:18:06.803 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T22:18:06.997 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T22:18:07.012 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T22:18:07.055 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T22:18:07.148 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T22:18:07.162 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T22:18:07.206 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T22:18:07.812 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-04-26T22:18:07.827 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T22:18:08.083 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T22:18:08.293 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests. 2024-04-26T22:18:08.308 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T22:18:08.351 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T22:18:08.395 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T22:18:08.411 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T22:18:08.453 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T22:18:08.679 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T22:18:08.694 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T22:18:08.737 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T22:18:08.756 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T22:18:08.772 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T22:18:08.814 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T22:18:09.024 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T22:18:09.038 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:09.082 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:09.126 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T22:18:09.141 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T22:18:09.184 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T22:18:09.428 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T22:18:09.442 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:09.454 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T22:18:09.469 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T22:18:09.478 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:09.529 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T22:18:09.781 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T22:18:09.795 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T22:18:09.839 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T22:18:09.866 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T22:18:09.882 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T22:18:09.924 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T22:18:10.165 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T22:18:10.181 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T22:18:10.219 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-04-26T22:18:10.225 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T22:18:10.235 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T22:18:10.277 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T22:18:10.528 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T22:18:10.543 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:10.563 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T22:18:10.578 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:10.579 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T22:18:10.622 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T22:18:10.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T22:18:10.946 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:10.967 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-04-26T22:18:10.982 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T22:18:10.989 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:11.025 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T22:18:11.320 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T22:18:11.335 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T22:18:11.386 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T22:18:11.543 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T22:18:11.557 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:11.601 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:11.672 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T22:18:11.688 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:11.731 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:12.152 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T22:18:12.168 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:12.210 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:12.404 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2024-04-26T22:18:12.418 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:12.438 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T22:18:12.454 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T22:18:12.470 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:12.488 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T22:18:12.799 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T22:18:12.815 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T22:18:12.857 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T22:18:13.032 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T22:18:13.047 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:13.098 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:13.194 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T22:18:13.215 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:13.452 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:13.518 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T22:18:13.533 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:13.576 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:13.847 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T22:18:13.863 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:13.905 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:13.946 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephadm. 2024-04-26T22:18:13.960 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:14.004 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:14.299 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T22:18:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T22:18:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T22:18:14.401 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T22:18:14.416 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:14.450 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:14.660 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T22:18:14.674 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T22:18:14.718 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:15.229 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-04-26T22:18:15.244 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:15.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:15.606 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T22:18:15.622 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:15.664 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:15.698 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-babel. 2024-04-26T22:18:15.711 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T22:18:15.756 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:16.051 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T22:18:16.066 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:16.067 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T22:18:16.080 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T22:18:16.109 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:16.125 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T22:18:16.486 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T22:18:16.495 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-04-26T22:18:16.500 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:16.511 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:16.544 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:16.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:16.789 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T22:18:16.805 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T22:18:16.839 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T22:18:16.873 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T22:18:16.886 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T22:18:16.931 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T22:18:17.134 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T22:18:17.149 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T22:18:17.184 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:17.234 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-routes. 2024-04-26T22:18:17.248 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T22:18:17.292 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T22:18:17.628 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T22:18:17.642 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:17.687 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:18.155 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-04-26T22:18:18.169 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T22:18:18.205 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:18.525 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T22:18:18.539 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T22:18:18.574 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T22:18:18.875 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T22:18:18.878 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T22:18:18.889 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T22:18:18.892 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:18.925 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T22:18:18.927 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:19.223 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T22:18:19.237 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T22:18:19.273 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T22:18:19.378 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T22:18:19.392 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T22:18:19.462 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T22:18:19.542 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-04-26T22:18:19.557 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T22:18:19.600 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T22:18:19.807 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T22:18:19.821 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T22:18:19.903 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T22:18:19.919 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:19.942 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T22:18:19.953 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:20.237 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T22:18:20.250 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T22:18:20.289 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T22:18:20.887 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T22:18:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:20.937 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:21.125 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T22:18:21.139 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T22:18:21.175 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T22:18:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T22:18:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T22:18:21.644 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T22:18:21.940 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T22:18:21.955 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T22:18:21.999 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T22:18:21.999 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T22:18:22.013 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T22:18:22.134 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T22:18:22.301 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T22:18:22.316 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T22:18:22.359 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T22:18:22.403 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T22:18:22.418 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T22:18:22.461 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T22:18:22.730 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T22:18:22.744 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T22:18:22.788 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T22:18:23.087 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T22:18:23.102 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:23.154 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:23.291 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T22:18:23.306 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T22:18:23.340 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T22:18:23.645 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T22:18:23.659 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T22:18:23.702 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T22:18:24.054 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T22:18:24.069 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T22:18:24.114 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T22:18:24.383 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T22:18:24.401 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T22:18:24.426 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T22:18:24.440 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T22:18:24.458 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T22:18:24.483 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T22:18:24.771 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T22:18:24.785 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T22:18:24.820 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T22:18:24.845 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T22:18:24.856 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T22:18:24.895 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T22:18:25.492 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T22:18:25.506 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:25.550 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:25.616 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T22:18:25.629 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T22:18:25.674 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T22:18:25.861 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T22:18:25.875 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T22:18:25.911 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T22:18:25.960 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T22:18:25.976 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T22:18:26.010 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T22:18:26.231 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T22:18:26.245 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T22:18:26.289 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T22:18:26.322 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T22:18:26.336 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T22:18:26.380 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T22:18:26.550 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2024-04-26T22:18:26.564 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T22:18:26.608 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T22:18:26.683 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T22:18:26.698 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T22:18:26.742 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T22:18:26.861 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2024-04-26T22:18:26.875 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T22:18:26.919 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T22:18:27.062 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T22:18:27.078 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T22:18:27.119 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T22:18:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T22:18:27.261 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T22:18:27.306 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T22:18:27.434 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T22:18:27.447 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T22:18:27.482 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T22:18:27.643 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2024-04-26T22:18:27.657 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:27.701 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:28.129 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T22:18:28.142 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:28.186 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:28.498 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T22:18:28.512 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T22:18:28.581 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T22:18:29.018 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T22:18:29.031 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T22:18:29.312 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T22:18:29.529 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-04-26T22:18:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T22:18:29.586 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T22:18:29.764 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T22:18:29.780 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:29.831 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:29.865 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-04-26T22:18:29.881 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T22:18:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T22:18:30.227 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T22:18:30.242 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:30.251 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T22:18:30.266 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T22:18:30.309 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T22:18:30.310 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:30.579 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T22:18:30.595 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T22:18:30.638 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-04-26T22:18:30.646 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T22:18:30.652 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:30.696 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:30.899 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T22:18:30.914 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:30.957 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:31.218 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T22:18:31.233 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:31.276 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:31.528 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T22:18:31.543 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:31.586 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:31.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T22:18:31.947 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T22:18:31.989 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T22:18:32.277 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T22:18:32.292 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T22:18:32.327 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T22:18:32.672 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T22:18:32.688 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T22:18:32.709 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T22:18:32.724 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:32.730 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T22:18:32.767 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:33.135 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pkg-config. 2024-04-26T22:18:33.147 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T22:18:33.150 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T22:18:33.162 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:33.194 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T22:18:33.204 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:33.463 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T22:18:33.478 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T22:18:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T22:18:33.515 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T22:18:33.521 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T22:18:33.557 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T22:18:33.835 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T22:18:33.850 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:33.885 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:33.941 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T22:18:33.956 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T22:18:33.999 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T22:18:34.121 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T22:18:34.136 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T22:18:34.179 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:34.269 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T22:18:34.282 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T22:18:34.318 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T22:18:34.423 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T22:18:34.438 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:34.473 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:34.614 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T22:18:34.628 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T22:18:34.663 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T22:18:34.759 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T22:18:34.774 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T22:18:34.817 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T22:18:35.000 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T22:18:35.014 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T22:18:35.058 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T22:18:35.122 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T22:18:35.137 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T22:18:35.172 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T22:18:35.360 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-py. 2024-04-26T22:18:35.375 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T22:18:35.410 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T22:18:35.509 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T22:18:35.527 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T22:18:35.567 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T22:18:35.697 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T22:18:35.711 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T22:18:35.747 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T22:18:35.989 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-04-26T22:18:36.005 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T22:18:36.047 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T22:18:36.193 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T22:18:36.207 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T22:18:36.250 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T22:18:36.309 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T22:18:36.325 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T22:18:36.366 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T22:18:36.587 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-toml. 2024-04-26T22:18:36.601 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T22:18:36.645 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T22:18:36.795 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T22:18:36.811 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T22:18:36.853 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T22:18:36.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T22:18:36.945 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T22:18:36.989 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T22:18:37.114 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T22:18:37.130 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T22:18:37.164 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T22:18:37.326 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T22:18:37.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T22:18:37.384 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T22:18:37.518 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T22:18:37.534 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T22:18:37.576 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T22:18:37.636 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T22:18:37.651 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T22:18:37.695 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T22:18:37.845 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T22:18:37.861 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T22:18:37.895 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T22:18:38.215 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-04-26T22:18:38.231 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T22:18:38.273 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T22:18:38.601 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T22:18:38.618 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T22:18:38.641 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2024-04-26T22:18:38.655 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:38.659 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T22:18:38.715 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:39.121 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T22:18:39.240 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T22:18:39.240 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T22:18:39.343 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T22:18:39.358 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:39.394 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:39.485 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-04-26T22:18:39.499 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T22:18:39.540 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T22:18:39.686 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T22:18:39.786 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T22:18:39.802 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T22:18:39.835 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T22:18:39.949 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T22:18:40.075 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T22:18:40.197 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T22:18:40.214 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T22:18:40.255 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T22:18:40.330 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T22:18:40.525 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T22:18:40.541 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T22:18:40.583 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T22:18:40.735 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T22:18:41.270 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-04-26T22:18:41.285 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:41.319 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:41.346 INFO:teuthology.orchestra.run.smithi195.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T22:18:41.393 INFO:teuthology.orchestra.run.smithi195.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T22:18:41.435 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:41.895 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user cephadm....done 2024-04-26T22:18:41.950 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T22:18:41.966 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T22:18:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:42.023 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T22:18:42.284 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T22:18:42.303 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T22:18:42.543 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T22:18:42.613 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T22:18:42.694 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T22:18:42.714 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T22:18:42.945 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T22:18:42.985 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T22:18:43.196 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T22:18:43.322 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T22:18:43.378 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T22:18:43.625 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T22:18:43.935 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T22:18:43.985 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T22:18:43.991 INFO:teuthology.orchestra.run.smithi016.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T22:18:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:44.253 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T22:18:44.512 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T22:18:44.559 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-04-26T22:18:44.705 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T22:18:44.788 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T22:18:45.014 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T22:18:45.033 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T22:18:45.283 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T22:18:45.309 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T22:18:45.409 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T22:18:45.577 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T22:18:45.677 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T22:18:45.836 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:45.953 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T22:18:46.070 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T22:18:46.087 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T22:18:46.213 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T22:18:46.339 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T22:18:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T22:18:46.607 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T22:18:46.733 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T22:18:46.757 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T22:18:46.992 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T22:18:47.034 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T22:18:47.301 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T22:18:47.381 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T22:18:47.431 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T22:18:47.495 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T22:18:47.621 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T22:18:47.636 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T22:18:47.879 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T22:18:47.998 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:48.115 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T22:18:48.155 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T22:18:48.366 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T22:18:48.423 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T22:18:48.642 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T22:18:48.691 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:48.952 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T22:18:49.000 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T22:18:49.078 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T22:18:49.126 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T22:18:49.252 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T22:18:49.520 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T22:18:49.621 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T22:18:49.771 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T22:18:49.897 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T22:18:50.039 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T22:18:50.165 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T22:18:50.291 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T22:18:50.297 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T22:18:50.328 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T22:18:50.392 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T22:18:50.518 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T22:18:50.617 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T22:18:50.895 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T22:18:51.004 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T22:18:51.027 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T22:18:51.272 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T22:18:51.278 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T22:18:51.540 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T22:18:51.646 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T22:18:51.849 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T22:18:51.947 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T22:18:51.975 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T22:18:52.265 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T22:18:52.599 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T22:18:52.694 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T22:18:52.884 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T22:18:52.962 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T22:18:53.010 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:53.063 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T22:18:53.189 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T22:18:53.311 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T22:18:53.515 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T22:18:53.812 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T22:18:53.933 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T22:18:54.201 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T22:18:54.602 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T22:18:55.027 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T22:18:55.220 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T22:18:55.278 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:18:55.412 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T22:18:55.529 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T22:18:55.680 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T22:18:55.806 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T22:18:55.873 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T22:18:55.932 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T22:18:56.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T22:18:56.234 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T22:18:56.300 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:18:56.501 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T22:18:56.618 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T22:18:56.761 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:18:56.862 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T22:18:56.969 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T22:18:57.155 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T22:18:57.414 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T22:18:57.673 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T22:18:57.924 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T22:18:58.201 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T22:18:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T22:18:58.477 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T22:18:58.494 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:18:58.586 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T22:18:58.611 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T22:18:58.879 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T22:18:58.879 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T22:18:58.988 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T22:18:59.004 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T22:18:59.114 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T22:18:59.298 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T22:18:59.441 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T22:18:59.607 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T22:18:59.717 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T22:18:59.858 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T22:18:59.992 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T22:19:00.010 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:19:00.118 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T22:19:00.161 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T22:19:00.198 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T22:19:00.436 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T22:19:00.462 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T22:19:00.537 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T22:19:00.705 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T22:19:00.922 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T22:19:00.981 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T22:19:01.190 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T22:19:01.249 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T22:19:01.299 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T22:19:01.550 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T22:19:01.567 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:19:01.693 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T22:19:01.835 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T22:19:01.961 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T22:19:02.019 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T22:19:02.262 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T22:19:02.312 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T22:19:02.363 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T22:19:02.579 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T22:19:02.672 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T22:19:02.808 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T22:19:02.990 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T22:19:03.075 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T22:19:03.258 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T22:19:03.352 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T22:19:03.384 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T22:19:03.510 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T22:19:03.599 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T22:19:03.611 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T22:19:03.853 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T22:19:03.954 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T22:19:03.971 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T22:19:04.256 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T22:19:04.356 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T22:19:04.592 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T22:19:04.632 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T22:19:04.718 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:04.766 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T22:19:04.844 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:04.970 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T22:19:05.076 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T22:19:05.202 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T22:19:05.306 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:05.407 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:05.528 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T22:19:05.533 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T22:19:05.827 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:05.829 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T22:19:05.969 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:06.095 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:06.105 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T22:19:06.302 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T22:19:06.302 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T22:19:06.367 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T22:19:06.651 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T22:19:06.922 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:06.936 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T22:19:07.047 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:07.165 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:07.195 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T22:19:07.283 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:07.417 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T22:19:07.606 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T22:19:07.907 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T22:19:08.276 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T22:19:08.402 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:08.512 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:08.612 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T22:19:08.687 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:08.847 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:08.965 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:08.972 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.090 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.100 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.199 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.226 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T22:19:09.326 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.537 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.646 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.746 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:09.870 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2024-04-26T22:19:09.959 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T22:19:09.959 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T22:19:10.171 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2024-04-26T22:19:10.299 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2024-04-26T22:19:10.341 INFO:teuthology.orchestra.run.smithi195.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T22:19:10.483 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T22:19:10.598 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:10.724 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:10.859 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:10.868 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T22:19:10.985 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:11.111 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T22:19:11.502 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:11.710 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T22:19:11.710 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T22:19:12.311 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.412 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.473 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.624 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.750 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.876 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T22:19:12.934 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T22:19:13.001 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:13.128 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:13.514 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:13.631 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-04-26T22:19:13.851 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T22:19:14.049 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-04-26T22:19:14.218 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-04-26T22:19:14.239 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T22:19:14.393 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T22:19:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:14.722 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T22:19:14.722 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T22:19:14.780 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T22:19:15.335 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:15.445 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:15.530 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T22:19:15.531 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T22:19:15.652 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T22:19:15.652 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T22:19:16.178 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:16.222 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:16.364 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:16.488 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T22:19:16.488 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T22:19:16.907 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T22:19:16.907 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T22:19:17.097 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:17.222 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:17.365 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:17.525 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:17.572 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T22:19:17.572 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T22:19:17.916 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T22:19:18.266 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:18.409 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:18.510 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:18.551 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:18.627 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:18.780 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T22:19:18.780 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T22:19:18.972 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T22:19:19.073 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T22:19:19.250 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T22:19:19.421 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:19.641 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T22:19:19.641 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T22:19:20.255 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:20.342 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T22:19:20.601 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T22:19:20.601 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T22:19:20.982 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T22:19:20.986 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T22:19:21.060 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-04-26T22:19:21.207 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:21.235 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-04-26T22:19:21.235 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-04-26T22:19:21.333 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T22:19:21.407 INFO:teuthology.orchestra.run.smithi195.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T22:19:21.408 INFO:teuthology.orchestra.run.smithi195.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T22:19:21.408 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T22:19:21.408 INFO:teuthology.orchestra.run.smithi195.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T22:19:21.408 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T22:19:21.409 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-04-26T22:19:21.409 INFO:teuthology.orchestra.run.smithi195.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T22:19:21.409 INFO:teuthology.orchestra.run.smithi195.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T22:19:21.410 INFO:teuthology.orchestra.run.smithi195.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T22:19:21.410 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T22:19:21.410 INFO:teuthology.orchestra.run.smithi195.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T22:19:21.411 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-04-26T22:19:21.411 INFO:teuthology.orchestra.run.smithi195.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T22:19:21.411 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T22:19:21.411 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T22:19:21.464 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-04-26T22:19:21.464 INFO:teuthology.orchestra.run.smithi195.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T22:19:21.465 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T22:19:21.466 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-04-26T22:19:21.467 INFO:teuthology.orchestra.run.smithi195.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T22:19:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:21.530 INFO:teuthology.orchestra.run.smithi195.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T22:19:21.530 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 55.7 MB of archives. 2024-04-26T22:19:21.530 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T22:19:21.530 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T22:19:21.695 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T22:19:21.702 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T22:19:21.718 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T22:19:21.718 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T22:19:21.742 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T22:19:21.743 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T22:19:21.744 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T22:19:21.755 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T22:19:21.756 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T22:19:21.758 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T22:19:21.759 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T22:19:21.759 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T22:19:21.760 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T22:19:21.774 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T22:19:21.775 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T22:19:21.775 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T22:19:21.794 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T22:19:22.081 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T22:19:22.083 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T22:19:22.083 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T22:19:22.087 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T22:19:22.088 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T22:19:22.093 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T22:19:22.095 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T22:19:22.103 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T22:19:22.104 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T22:19:22.136 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T22:19:22.137 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T22:19:22.148 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T22:19:22.183 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T22:19:22.189 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T22:19:22.190 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T22:19:22.191 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T22:19:22.191 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T22:19:22.204 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T22:19:22.215 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T22:19:22.311 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:22.424 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T22:19:22.424 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T22:19:22.424 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T22:19:22.425 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T22:19:22.425 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T22:19:22.425 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T22:19:22.428 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:22.439 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T22:19:22.439 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T22:19:22.537 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:22.730 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T22:19:22.816 INFO:teuthology.orchestra.run.smithi195.stdout:Preconfiguring packages ... 2024-04-26T22:19:22.957 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 55.7 MB in 1s (57.7 MB/s) 2024-04-26T22:19:23.100 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T22:19:23.217 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T22:19:23.245 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T22:19:23.248 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:23.369 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T22:19:23.390 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:24.040 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:24.629 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T22:19:25.137 INFO:teuthology.orchestra.run.smithi195.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T22:19:25.401 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T22:19:25.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T22:19:25.485 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T22:19:25.497 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package flex. 2024-04-26T22:19:25.569 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T22:19:25.573 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:25.612 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T22:19:25.665 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T22:19:25.666 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T22:19:25.844 INFO:teuthology.orchestra.run.smithi016.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T22:19:25.844 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T22:19:25.844 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T22:19:25.844 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T22:19:25.845 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T22:19:25.846 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T22:19:25.846 INFO:teuthology.orchestra.run.smithi016.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T22:19:25.846 INFO:teuthology.orchestra.run.smithi016.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T22:19:25.847 INFO:teuthology.orchestra.run.smithi016.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T22:19:25.847 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T22:19:25.847 INFO:teuthology.orchestra.run.smithi016.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T22:19:25.848 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T22:19:25.848 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T22:19:25.848 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T22:19:25.848 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T22:19:25.904 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T22:19:25.904 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T22:19:25.905 INFO:teuthology.orchestra.run.smithi016.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T22:19:25.905 INFO:teuthology.orchestra.run.smithi016.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T22:19:25.905 INFO:teuthology.orchestra.run.smithi016.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T22:19:25.905 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T22:19:25.906 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T22:19:25.906 INFO:teuthology.orchestra.run.smithi016.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T22:19:25.906 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-04-26T22:19:25.907 INFO:teuthology.orchestra.run.smithi016.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T22:19:25.971 INFO:teuthology.orchestra.run.smithi016.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T22:19:25.971 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 55.7 MB of archives. 2024-04-26T22:19:25.971 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T22:19:25.971 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T22:19:26.146 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T22:19:26.148 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T22:19:26.152 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T22:19:26.189 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T22:19:26.190 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T22:19:26.190 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T22:19:26.200 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T22:19:26.200 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T22:19:26.202 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T22:19:26.203 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T22:19:26.203 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T22:19:26.205 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T22:19:26.216 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T22:19:26.216 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T22:19:26.217 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T22:19:26.236 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T22:19:26.326 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T22:19:26.597 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T22:19:26.599 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T22:19:26.599 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T22:19:26.602 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T22:19:26.602 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T22:19:26.606 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T22:19:26.608 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T22:19:26.618 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T22:19:26.619 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T22:19:26.655 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T22:19:26.661 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T22:19:26.671 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T22:19:26.702 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T22:19:26.709 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T22:19:26.709 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T22:19:26.710 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T22:19:26.710 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T22:19:26.717 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:26.731 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T22:19:26.735 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T22:19:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T22:19:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T22:19:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T22:19:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T22:19:26.955 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T22:19:26.955 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T22:19:26.968 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T22:19:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T22:19:27.231 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T22:19:27.234 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:27.342 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:27.362 INFO:teuthology.orchestra.run.smithi016.stdout:Preconfiguring packages ... 2024-04-26T22:19:27.529 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 55.7 MB in 1s (52.9 MB/s) 2024-04-26T22:19:27.737 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:27.800 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T22:19:27.803 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:27.873 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:27.952 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:28.171 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:28.490 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package bison. 2024-04-26T22:19:28.562 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T22:19:28.566 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T22:19:28.579 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:28.600 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T22:19:28.960 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T22:19:28.975 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T22:19:29.010 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T22:19:29.339 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package dump. 2024-04-26T22:19:29.353 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T22:19:29.396 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T22:19:29.675 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package indent. 2024-04-26T22:19:29.690 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:29.717 INFO:teuthology.orchestra.run.smithi016.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T22:19:29.733 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T22:19:29.953 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T22:19:29.968 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T22:19:29.975 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2024-04-26T22:19:30.002 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T22:19:30.049 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T22:19:30.052 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:30.098 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T22:19:30.382 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T22:19:30.398 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T22:19:30.440 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T22:19:30.652 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T22:19:30.701 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T22:19:30.717 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T22:19:30.759 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T22:19:30.821 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T22:19:31.021 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T22:19:31.037 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:31.071 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:31.188 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:31.307 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T22:19:31.323 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:31.365 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:31.618 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T22:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T22:19:31.676 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T22:19:31.754 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T22:19:31.757 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:31.878 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:31.979 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T22:19:31.995 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T22:19:32.029 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T22:19:32.259 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T22:19:32.393 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T22:19:32.718 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:33.094 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2024-04-26T22:19:33.176 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T22:19:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T22:19:33.222 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T22:19:33.357 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T22:19:33.373 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T22:19:33.440 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:33.614 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T22:19:33.630 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T22:19:33.672 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T22:19:33.693 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T22:19:33.709 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T22:19:33.751 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:33.992 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2024-04-26T22:19:34.008 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T22:19:34.054 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T22:19:34.070 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T22:19:34.077 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T22:19:34.112 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:34.356 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2024-04-26T22:19:34.372 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:34.414 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T22:19:34.457 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T22:19:34.473 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T22:19:34.515 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T22:19:34.726 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T22:19:34.742 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T22:19:34.784 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T22:19:34.801 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T22:19:34.817 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T22:19:34.851 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T22:19:35.063 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T22:19:35.080 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T22:19:35.121 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T22:19:35.213 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T22:19:35.228 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:35.329 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:35.408 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T22:19:35.424 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T22:19:35.595 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T22:19:35.683 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T22:19:35.698 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:35.741 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:19:35.794 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T22:19:35.810 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:35.861 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:36.030 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T22:19:36.045 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:36.088 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:19:36.164 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T22:19:36.180 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T22:19:36.230 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:36.340 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T22:19:36.356 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T22:19:36.399 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:36.533 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T22:19:36.549 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T22:19:36.624 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T22:19:36.953 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T22:19:36.969 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T22:19:37.011 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T22:19:37.011 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T22:19:37.026 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T22:19:37.086 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T22:19:37.439 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package modemmanager. 2024-04-26T22:19:37.455 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T22:19:37.497 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:38.096 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager. 2024-04-26T22:19:38.112 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T22:19:38.153 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T22:19:38.447 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T22:19:38.464 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T22:19:38.514 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:38.711 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ppp. 2024-04-26T22:19:38.726 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T22:19:38.817 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T22:19:38.833 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T22:19:38.883 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:39.054 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T22:19:39.236 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T22:19:39.253 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T22:19:39.319 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:39.349 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T22:19:39.363 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T22:19:39.407 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T22:19:39.647 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T22:19:39.664 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T22:19:39.685 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T22:19:39.700 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T22:19:39.705 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T22:19:39.743 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T22:19:40.030 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T22:19:40.045 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T22:19:40.088 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T22:19:40.093 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T22:19:40.109 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T22:19:40.151 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T22:19:40.446 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T22:19:40.462 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:40.496 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:40.526 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T22:19:40.541 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:40.585 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:40.857 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T22:19:40.874 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:40.916 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:19:41.065 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T22:19:41.079 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T22:19:41.158 INFO:teuthology.orchestra.run.smithi195.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T22:19:41.188 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-common (238) ... 2024-04-26T22:19:41.201 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T22:19:41.218 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:41.259 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:19:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T22:19:41.512 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T22:19:41.545 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:41.655 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T22:19:41.670 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:41.716 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:42.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T22:19:42.107 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T22:19:42.149 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T22:19:42.461 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package modemmanager. 2024-04-26T22:19:42.477 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T22:19:42.519 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:42.767 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql. 2024-04-26T22:19:42.782 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T22:19:42.825 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql (14+238) ... 2024-04-26T22:19:43.052 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T22:19:43.067 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T22:19:43.110 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T22:19:43.218 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager. 2024-04-26T22:19:43.234 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T22:19:43.284 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T22:19:43.355 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T22:19:43.369 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T22:19:43.412 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T22:19:43.724 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T22:19:43.738 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T22:19:43.773 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T22:19:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ppp. 2024-04-26T22:19:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T22:19:44.043 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package tcl. 2024-04-26T22:19:44.058 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T22:19:44.105 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T22:19:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T22:19:44.488 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T22:19:44.503 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T22:19:44.545 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T22:19:44.629 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T22:19:44.645 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T22:19:44.688 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T22:19:44.875 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T22:19:44.890 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T22:19:44.924 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T22:19:45.084 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T22:19:45.100 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T22:19:45.143 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T22:19:45.270 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T22:19:45.285 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T22:19:45.336 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T22:19:45.454 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T22:19:45.470 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T22:19:45.512 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T22:19:45.630 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T22:19:45.876 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T22:19:45.891 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T22:19:45.908 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:45.950 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:46.002 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T22:19:46.128 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:46.254 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T22:19:46.355 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T22:19:46.456 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:46.538 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T22:19:46.554 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T22:19:46.616 INFO:teuthology.orchestra.run.smithi016.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T22:19:46.645 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-common (238) ... 2024-04-26T22:19:47.112 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T22:19:47.128 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T22:19:47.173 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:47.389 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T22:19:47.478 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T22:19:47.839 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T22:19:47.839 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T22:19:48.265 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql. 2024-04-26T22:19:48.280 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T22:19:48.314 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql (14+238) ... 2024-04-26T22:19:48.526 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T22:19:48.531 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:48.540 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T22:19:48.583 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T22:19:48.640 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T22:19:48.782 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:48.827 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T22:19:48.842 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T22:19:48.885 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T22:19:48.909 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T22:19:49.035 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T22:19:49.161 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:49.205 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T22:19:49.220 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T22:19:49.263 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T22:19:49.287 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T22:19:49.396 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T22:19:49.557 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl. 2024-04-26T22:19:49.573 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T22:19:49.621 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T22:19:49.935 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T22:19:49.952 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T22:19:49.993 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T22:19:50.001 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T22:19:50.119 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T22:19:50.213 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T22:19:50.279 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:50.340 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T22:19:50.355 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T22:19:50.397 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T22:19:50.413 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T22:19:50.514 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T22:19:50.649 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T22:19:50.743 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T22:19:50.759 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T22:19:50.775 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T22:19:50.809 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T22:19:50.864 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T22:19:50.926 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T22:19:51.052 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T22:19:51.096 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T22:19:51.228 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T22:19:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T22:19:51.363 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:51.391 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T22:19:51.464 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T22:19:51.517 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:51.599 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T22:19:51.643 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T22:19:51.708 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T22:19:51.769 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T22:19:51.929 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout:which means they are currently configured by ifupdown: 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout:- enp3s0f1 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T22:19:52.284 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:52.415 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T22:19:52.814 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T22:19:52.892 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T22:19:52.985 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T22:19:53.234 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T22:19:53.395 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T22:19:53.395 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T22:19:54.002 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T22:19:54.214 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T22:19:54.230 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:54.323 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T22:19:54.415 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T22:19:54.457 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T22:19:54.566 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T22:19:54.651 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-common (238) ... 2024-04-26T22:19:54.809 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T22:19:54.935 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T22:19:55.061 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T22:19:55.725 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T22:19:55.851 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T22:19:55.870 INFO:teuthology.orchestra.run.smithi195.stdout:Adding user postgres to group ssl-cert 2024-04-26T22:19:55.946 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T22:19:56.003 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:19:56.115 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:56.115 INFO:teuthology.orchestra.run.smithi195.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T22:19:56.375 INFO:teuthology.orchestra.run.smithi195.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T22:19:56.376 INFO:teuthology.orchestra.run.smithi195.stdout:Removing obsolete dictionary files: 2024-04-26T22:19:56.503 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T22:19:56.638 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T22:19:56.764 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T22:19:56.882 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T22:19:56.997 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T22:19:57.062 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T22:19:57.067 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T22:19:57.192 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T22:19:57.369 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T22:19:57.495 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:19:57.533 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:19:57.613 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T22:19:57.748 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T22:19:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T22:19:57.878 INFO:teuthology.orchestra.run.smithi195.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T22:19:57.895 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T22:19:57.940 INFO:teuthology.orchestra.run.smithi195.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T22:19:57.940 INFO:teuthology.orchestra.run.smithi195.stdout:This user must also own the server process. 2024-04-26T22:19:57.940 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:57.940 INFO:teuthology.orchestra.run.smithi195.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T22:19:57.940 INFO:teuthology.orchestra.run.smithi195.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:The default text search configuration will be set to "english". 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:Data page checksums are disabled. 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:creating subdirectories ... ok 2024-04-26T22:19:57.941 INFO:teuthology.orchestra.run.smithi195.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T22:19:57.965 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default max_connections ... 100 2024-04-26T22:19:57.998 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default shared_buffers ... 128MB 2024-04-26T22:19:58.012 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default time zone ... Etc/UTC 2024-04-26T22:19:58.013 INFO:teuthology.orchestra.run.smithi195.stdout:creating configuration files ... ok 2024-04-26T22:19:58.177 INFO:teuthology.orchestra.run.smithi195.stdout:running bootstrap script ... ok 2024-04-26T22:19:58.438 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout:which means they are currently configured by ifupdown: 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout:- ens1f0 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T22:19:58.439 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:19:58.579 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T22:19:58.809 INFO:teuthology.orchestra.run.smithi195.stdout:performing post-bootstrap initialization ... ok 2024-04-26T22:19:58.973 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T22:19:59.351 INFO:teuthology.orchestra.run.smithi195.stdout:syncing data to disk ... ok 2024-04-26T22:19:59.366 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T22:19:59.862 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T22:20:00.010 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T22:20:00.153 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T22:20:00.621 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T22:20:00.772 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-common (238) ... 2024-04-26T22:20:01.733 INFO:teuthology.orchestra.run.smithi016.stdout:Adding user postgres to group ssl-cert 2024-04-26T22:20:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:01.991 INFO:teuthology.orchestra.run.smithi016.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T22:20:02.259 INFO:teuthology.orchestra.run.smithi016.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T22:20:02.259 INFO:teuthology.orchestra.run.smithi016.stdout:Removing obsolete dictionary files: 2024-04-26T22:20:02.825 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:20:02.928 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T22:20:02.942 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T22:20:03.060 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql (14+238) ... 2024-04-26T22:20:03.169 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:20:03.295 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:20:03.448 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T22:20:03.563 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T22:20:03.563 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T22:20:03.780 INFO:teuthology.orchestra.run.smithi016.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T22:20:03.798 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T22:20:03.855 INFO:teuthology.orchestra.run.smithi016.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:This user must also own the server process. 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:The default text search configuration will be set to "english". 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:Data page checksums are disabled. 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:03.856 INFO:teuthology.orchestra.run.smithi016.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T22:20:03.857 INFO:teuthology.orchestra.run.smithi016.stdout:creating subdirectories ... ok 2024-04-26T22:20:03.857 INFO:teuthology.orchestra.run.smithi016.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T22:20:03.881 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default max_connections ... 100 2024-04-26T22:20:03.916 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default shared_buffers ... 128MB 2024-04-26T22:20:03.931 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default time zone ... Etc/UTC 2024-04-26T22:20:03.931 INFO:teuthology.orchestra.run.smithi016.stdout:creating configuration files ... ok 2024-04-26T22:20:04.105 INFO:teuthology.orchestra.run.smithi016.stdout:running bootstrap script ... ok 2024-04-26T22:20:04.331 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T22:20:04.423 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T22:20:04.735 INFO:teuthology.orchestra.run.smithi016.stdout:performing post-bootstrap initialization ... ok 2024-04-26T22:20:04.783 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T22:20:04.927 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T22:20:05.250 INFO:teuthology.orchestra.run.smithi016.stdout:syncing data to disk ... ok 2024-04-26T22:20:05.734 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T22:20:06.003 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T22:20:06.094 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T22:20:06.627 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T22:20:06.635 DEBUG:teuthology.parallel:result is None 2024-04-26T22:20:08.731 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:20:08.840 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T22:20:08.966 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql (14+238) ... 2024-04-26T22:20:09.092 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T22:20:09.218 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T22:20:09.485 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T22:20:09.485 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T22:20:10.203 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T22:20:10.296 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T22:20:10.640 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T22:20:10.817 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T22:20:12.294 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T22:20:12.394 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T22:20:12.938 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T22:20:12.945 DEBUG:teuthology.parallel:result is None 2024-04-26T22:20:12.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:20:13.166 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-04-26T22:20:13.189 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:20:13.189 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:20:13.189 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T22:20:13.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T22:20:13.331 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2024-04-26T22:20:13.354 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:20:13.355 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T22:20:13.355 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T22:20:13.356 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T22:20:13.356 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:13.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T22:20:13.376 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:13.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T22:20:13.419 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T22:20:13.419 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:13.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T22:20:13.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T22:20:13.503 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:13.504 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T22:20:13.525 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T22:20:13.586 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T22:20:13.586 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:13.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T22:20:13.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T22:20:13.667 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:13.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T22:20:13.688 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T22:20:13.750 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T22:20:13.750 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:13.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T22:20:13.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T22:20:13.832 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:13.832 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T22:20:13.853 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T22:20:13.914 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T22:20:13.993 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T22:20:13.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-26T22:20:13.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-26T22:20:14.017 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T22:20:14.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T22:20:14.059 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T22:20:14.079 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T22:20:14.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T22:20:14.123 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T22:20:14.150 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T22:20:14.150 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T22:20:14.150 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T22:20:14.150 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:14.150 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T22:20:14.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T22:20:14.286 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:14.286 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T22:20:14.295 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T22:20:14.391 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T22:20:14.391 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T22:20:14.392 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell}', 'email': None, 'first_in_suite': False, 'job_id': '7675253', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdviHqzHs+vdNmyuFyasvDD/rfZLPuatmIaZogHh2SLOrwEmwQn3LVJ05oVH6D3A/yM6NjqgO+QbuA4ZB220rg=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB1S6+scQRZqt3NL0nI7n8ZTuZbylBMEgqqac11Hxg/27waG8oxqCdTGYejbKyIa/zH124AfkBmcYeZnSh5LIE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T22:20:14.392 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T22:20:14.395 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T22:20:14.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T22:20:14.447 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T22:20:14.467 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:14.468 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T22:20:14.521 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T22:20:14.521 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 22:13:05.763030409 +0000 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 22:13:05.503032728 +0000 2024-04-26T22:20:14.573 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 22:13:05.503032728 +0000 2024-04-26T22:20:14.574 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 22:13:05.503032728 +0000 2024-04-26T22:20:14.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T22:20:14.635 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T22:20:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T22:20:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000276886 s, 1.8 MB/s 2024-04-26T22:20:14.638 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T22:20:14.691 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-26T22:20:14.741 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T22:20:14.741 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:14.741 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-04-26T22:20:14.741 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:14.741 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 22:13:06.303025591 +0000 2024-04-26T22:20:14.742 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 22:13:06.043027910 +0000 2024-04-26T22:20:14.742 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 22:13:06.043027910 +0000 2024-04-26T22:20:14.742 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 22:13:06.043027910 +0000 2024-04-26T22:20:14.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T22:20:14.804 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T22:20:14.804 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T22:20:14.804 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000265088 s, 1.9 MB/s 2024-04-26T22:20:14.806 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T22:20:14.863 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 22:13:06.863020594 +0000 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 22:13:06.603022914 +0000 2024-04-26T22:20:14.913 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 22:13:06.603022914 +0000 2024-04-26T22:20:14.914 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 22:13:06.603022914 +0000 2024-04-26T22:20:14.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T22:20:14.975 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T22:20:14.975 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T22:20:14.975 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000271384 s, 1.9 MB/s 2024-04-26T22:20:14.977 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T22:20:15.031 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-26T22:20:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T22:20:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:15.081 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-04-26T22:20:15.081 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:15.081 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 22:13:07.399015814 +0000 2024-04-26T22:20:15.082 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 22:13:07.127018239 +0000 2024-04-26T22:20:15.082 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 22:13:07.127018239 +0000 2024-04-26T22:20:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-26 22:13:07.127018239 +0000 2024-04-26T22:20:15.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T22:20:15.144 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T22:20:15.144 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T22:20:15.144 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000295455 s, 1.7 MB/s 2024-04-26T22:20:15.146 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T22:20:15.199 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:15.199 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:15.199 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T22:20:15.208 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T22:20:15.208 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 22:13:03.380483977 +0000 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 22:13:03.120486295 +0000 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 22:13:03.120486295 +0000 2024-04-26T22:20:15.259 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 22:13:03.120486295 +0000 2024-04-26T22:20:15.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T22:20:15.321 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T22:20:15.321 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T22:20:15.321 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000274503 s, 1.9 MB/s 2024-04-26T22:20:15.323 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T22:20:15.377 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 913 Links: 1 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 22:13:03.952478874 +0000 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 22:13:03.680481301 +0000 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 22:13:03.680481301 +0000 2024-04-26T22:20:15.427 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 22:13:03.680481301 +0000 2024-04-26T22:20:15.427 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T22:20:15.488 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T22:20:15.489 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T22:20:15.489 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000273402 s, 1.9 MB/s 2024-04-26T22:20:15.490 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T22:20:15.545 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 22:13:04.540473628 +0000 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 22:13:04.272476019 +0000 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 22:13:04.272476019 +0000 2024-04-26T22:20:15.595 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 22:13:04.272476019 +0000 2024-04-26T22:20:15.596 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T22:20:15.657 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T22:20:15.658 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T22:20:15.658 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000281205 s, 1.8 MB/s 2024-04-26T22:20:15.660 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T22:20:15.713 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-26T22:20:15.762 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 949 Links: 1 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 22:13:05.096468669 +0000 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 22:13:04.824471095 +0000 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 22:13:04.824471095 +0000 2024-04-26T22:20:15.763 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 22:13:04.824471095 +0000 2024-04-26T22:20:15.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T22:20:15.824 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T22:20:15.824 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T22:20:15.824 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000273696 s, 1.9 MB/s 2024-04-26T22:20:15.826 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T22:20:15.880 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:15.880 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T22:20:15.881 INFO:tasks.ceph:Generating config... 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] pid file = 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T22:20:15.882 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T22:20:15.882 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T22:20:15.883 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T22:20:15.883 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T22:20:15.883 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T22:20:15.883 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T22:20:15.884 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T22:20:15.884 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T22:20:15.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T22:20:15.932 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T22:20:15.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T22:20:16.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T22:20:16.064 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-04-26T22:20:16.064 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T22:20:16.065 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:16.065 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T22:20:16.112 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 53f352df-dd5a-41be-a68c-8728a38a6452 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 53f352df-dd5a-41be-a68c-8728a38a6452 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-26T22:20:16.205697+0000 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-26T22:20:16.205697+0000 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-26T22:20:16.201 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-26T22:20:16.202 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-04-26T22:20:16.202 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-04-26T22:20:16.202 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T22:20:16.204 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T22:20:16.212 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 53f352df-dd5a-41be-a68c-8728a38a6452... 2024-04-26T22:20:16.213 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:20:16.255 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:20:16.296 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-26T22:20:16.296 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-26T22:20:16.296 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:20:16.296 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-26T22:20:16.296 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.297 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:20:16.298 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 53f352df-dd5a-41be-a68c-8728a38a6452 2024-04-26T22:20:16.299 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-26T22:20:16.300 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:20:16.301 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-04-26T22:20:16.302 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:20:16.303 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:20:16.304 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-04-26T22:20:16.305 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T22:20:16.306 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-26T22:20:16.307 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-26T22:20:16.308 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.309 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-26T22:20:16.310 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.16,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 53f352df-dd5a-41be-a68c-8728a38a6452 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-26T22:20:16.311 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.312 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-26T22:20:16.313 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T22:20:16.314 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-26T22:20:16.315 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:20:16.316 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: mon down mkfs grace = 300 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:20:16.317 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-04-26T22:20:16.318 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-04-26T22:20:16.319 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-04-26T22:20:16.320 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T22:20:16.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T22:20:16.422 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T22:20:16.422 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:16.422 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T22:20:16.431 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:16.431 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T22:20:16.480 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:20:16.480 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:16.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T22:20:16.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T22:20:16.552 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:16.552 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:16.604 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:20:16.605 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:16.605 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T22:20:16.605 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T22:20:16.639 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:16.639 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:16.691 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T22:20:16.691 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T22:20:16.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T22:20:16.746 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T22:20:16.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T22:20:16.810 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T22:20:16.822 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T22:20:16.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T22:20:16.879 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T22:20:16.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T22:20:16.904 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T22:20:16.960 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T22:20:16.965 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T22:20:16.984 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T22:20:16.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T22:20:17.028 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T22:20:17.045 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T22:20:17.045 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T22:20:17.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T22:20:17.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:17.107 INFO:tasks.ceph:role: osd.0 2024-04-26T22:20:17.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:20:17.107 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:17.167 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:17.196 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T22:20:17.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T22:20:17.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T22:20:17.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T22:20:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:17.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:17.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T22:20:17.387 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:17.387 INFO:tasks.ceph:role: osd.1 2024-04-26T22:20:17.387 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:20:17.387 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:17.451 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:17.452 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:17.486 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T22:20:17.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T22:20:17.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T22:20:17.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T22:20:17.620 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:17.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:17.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T22:20:17.683 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:17.683 INFO:tasks.ceph:role: osd.2 2024-04-26T22:20:17.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:20:17.683 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:17.747 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:17.776 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T22:20:17.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T22:20:17.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T22:20:17.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T22:20:17.904 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:17.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:17.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T22:20:17.967 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:17.967 INFO:tasks.ceph:role: osd.3 2024-04-26T22:20:17.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:20:17.967 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:18.027 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:18.055 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T22:20:18.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T22:20:18.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T22:20:18.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T22:20:18.184 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:18.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:18.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:18.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.311+0000 7f77a7bcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T22:20:18.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.311+0000 7f77a7bcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T22:20:18.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.311+0000 7f77a7bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T22:20:18.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.311+0000 7f77a7bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T22:20:18.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.311+0000 7f77a7bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T22:20:18.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:18.315+0000 7f77a7bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T22:20:21.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T22:20:21.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.471+0000 7fa69f1a77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T22:20:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.471+0000 7fa69f1a77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T22:20:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.471+0000 7fa69f1a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T22:20:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.471+0000 7fa69f1a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T22:20:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.471+0000 7fa69f1a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T22:20:21.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:21.475+0000 7fa69f1a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T22:20:24.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T22:20:24.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:24.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T22:20:24.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T22:20:24.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T22:20:24.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T22:20:24.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T22:20:24.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:24.663+0000 7fb2b78697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T22:20:27.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T22:20:27.741 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:27.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.843+0000 7f348687e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T22:20:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.843+0000 7f348687e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T22:20:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.843+0000 7f348687e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T22:20:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.843+0000 7f348687e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T22:20:27.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.843+0000 7f348687e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T22:20:27.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:27.847+0000 7f348687e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T22:20:30.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T22:20:30.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T22:20:30.977 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:30.978 INFO:tasks.ceph:role: osd.4 2024-04-26T22:20:30.978 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:20:30.978 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:31.038 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:31.062 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-26T22:20:31.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-26T22:20:31.065 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T22:20:31.131 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T22:20:31.189 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:31.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:31.190 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T22:20:31.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:31.253 INFO:tasks.ceph:role: osd.5 2024-04-26T22:20:31.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:20:31.253 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:31.312 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:31.336 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-26T22:20:31.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-26T22:20:31.339 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T22:20:31.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T22:20:31.465 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:31.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:31.466 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T22:20:31.528 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:31.528 INFO:tasks.ceph:role: osd.6 2024-04-26T22:20:31.528 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:20:31.528 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:31.589 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:31.613 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-26T22:20:31.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-26T22:20:31.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T22:20:31.682 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T22:20:31.741 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:31.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:31.742 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T22:20:31.804 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T22:20:31.804 INFO:tasks.ceph:role: osd.7 2024-04-26T22:20:31.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:20:31.804 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T22:20:31.864 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T22:20:31.865 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T22:20:31.888 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-26T22:20:31.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-26T22:20:31.891 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T22:20:31.962 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T22:20:32.016 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T22:20:32.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:20:32.018 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:32.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.127+0000 7f8dcaffd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T22:20:32.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.131+0000 7f8dcaffd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T22:20:32.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.131+0000 7f8dcaffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T22:20:32.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.131+0000 7f8dcaffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T22:20:32.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.131+0000 7f8dcaffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T22:20:32.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:32.131+0000 7f8dcaffd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T22:20:35.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T22:20:35.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:35.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T22:20:35.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T22:20:35.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T22:20:35.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T22:20:35.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T22:20:35.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:35.307+0000 7f3fed8cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T22:20:38.348 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T22:20:38.369 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:38.465 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.459+0000 7f5e6b45e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T22:20:38.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.459+0000 7f5e6b45e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T22:20:38.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.459+0000 7f5e6b45e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T22:20:38.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.459+0000 7f5e6b45e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T22:20:38.466 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.459+0000 7f5e6b45e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T22:20:38.467 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:38.463+0000 7f5e6b45e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T22:20:41.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T22:20:41.523 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:41.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T22:20:41.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T22:20:41.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T22:20:41.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T22:20:41.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T22:20:41.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:41.611+0000 7f7f492367c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T22:20:44.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:20:44.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:20:44.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T22:20:44.678 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T22:20:44.679 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T22:20:44.701 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T22:20:44.769 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T22:20:44.833 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T22:20:44.901 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T22:20:44.969 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:44.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T22:20:45.033 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.033 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T22:20:45.053 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T22:20:45.117 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.117 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T22:20:45.177 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.177 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T22:20:45.236 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.236 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T22:20:45.296 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:45.297 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T22:20:45.361 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:45.361 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T22:20:45.370 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T22:20:45.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T22:20:45.415 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCgKCxmktnCLBAABKCq4M+4u/ea20vgpj7hvA== 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCgKCxmMaSvNBAATfdR35RbzEMDGhPEw20keg== 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCiKCxm3AfhEhAAgIRGGpBsOrympcNEnROyWg== 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-26T22:20:45.431 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQClKCxmJ4NjHBAAZc8Cpvvcdms0QpeZj6YWhw== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCoKCxmXHytJxAAFz7Tz7guiAkAr+aIWWhtNQ== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCrKCxm8ZmDMhAAttmYyqVWpq60mMiP5ffXrg== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCgKCxmsSBeMBAARXtANOMUyLulgCJnX51R1w== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCgKCxm3RVRORAAzxdHTzRskCgg2cY10Euljw== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCwKCxmrEQUCBAAnTEKBvE532wesEUmHn3VVQ== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCzKCxmMGaoEhAAiA2+4q3IvYiBdqxVWGp5pg== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC2KCxmfgDWGxAAGOQa/3n2Wt8QwbqQwXS24w== 2024-04-26T22:20:45.432 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC5KCxm/dbDJBAAcGTn35fZ1L/C9lhkux7bsw== 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQChKCxmIPT0ARAAIv0bynjTbfZef5VoYTU1MQ== 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCgKCxmktnCLBAABKCq4M+4u/ea20vgpj7hvA== 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCgKCxmMaSvNBAATfdR35RbzEMDGhPEw20keg== 2024-04-26T22:20:45.433 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCiKCxm3AfhEhAAgIRGGpBsOrympcNEnROyWg== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQClKCxmJ4NjHBAAZc8Cpvvcdms0QpeZj6YWhw== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCoKCxmXHytJxAAFz7Tz7guiAkAr+aIWWhtNQ== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCrKCxm8ZmDMhAAttmYyqVWpq60mMiP5ffXrg== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCgKCxmsSBeMBAARXtANOMUyLulgCJnX51R1w== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCgKCxm3RVRORAAzxdHTzRskCgg2cY10Euljw== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCwKCxmrEQUCBAAnTEKBvE532wesEUmHn3VVQ== 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-04-26T22:20:45.434 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCzKCxmMGaoEhAAiA2+4q3IvYiBdqxVWGp5pg== 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQC2KCxmfgDWGxAAGOQa/3n2Wt8QwbqQwXS24w== 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQC5KCxm/dbDJBAAcGTn35fZ1L/C9lhkux7bsw== 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-04-26T22:20:45.435 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQChKCxmIPT0ARAAIv0bynjTbfZef5VoYTU1MQ== 2024-04-26T22:20:45.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T22:20:45.479 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T22:20:45.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T22:20:45.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T22:20:45.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.599 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.656 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.768 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T22:20:45.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T22:20:45.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T22:20:45.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T22:20:45.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.938 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:45.994 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:46.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:46.050 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:46.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:46.106 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T22:20:46.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T22:20:46.161 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T22:20:46.216 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T22:20:46.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T22:20:46.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T22:20:46.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T22:20:46.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T22:20:46.391 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T22:20:46.501 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T22:20:46.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T22:20:46.580 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T22:20:46.689 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T22:20:46.709 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:46.712 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T22:20:46.757 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T22:20:46.757 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T22:20:46.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T22:20:46.762 INFO:tasks.ceph.mon.a:Started 2024-04-26T22:20:46.763 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T22:20:46.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T22:20:46.800 INFO:tasks.ceph.mon.b:Started 2024-04-26T22:20:46.800 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T22:20:46.801 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T22:20:46.803 INFO:tasks.ceph.mon.c:Started 2024-04-26T22:20:46.803 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T22:20:46.804 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T22:20:46.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T22:20:46.807 INFO:tasks.ceph.mgr.y:Started 2024-04-26T22:20:46.807 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T22:20:46.807 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T22:20:46.810 INFO:tasks.ceph.mgr.x:Started 2024-04-26T22:20:46.810 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T22:20:46.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T22:20:46.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 Processor -- start 2024-04-26T22:20:46.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 -- start start 2024-04-26T22:20:46.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:46.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f44070480 con 0x7f3f4406e410 2024-04-26T22:20:46.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4406e7f0 con 0x7f3f441406e0 2024-04-26T22:20:46.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f4c800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3f44070a60 con 0x7f3f440b0a30 2024-04-26T22:20:46.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f49e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3f4406e410 0x7f3f4413ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:54576/0 (socket says 172.21.15.16:54576) 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 learned_addr learned my addr 172.21.15.16:0/1149667724 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.951+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:46.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:46.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:47.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:47.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.159+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:47.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.159+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:47.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:47.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:47.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:47.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.563+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:47.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.563+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:47.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:47.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:47.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:48.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:48.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:48.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:48.367+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:48.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:48.367+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:48.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:48.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:48.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:48.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T22:20:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 msgr2=0x7f3f441464e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f440b0a30 0x7f3f441464e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v1:172.21.15.195:6789/0 conn(0x7f3f441406e0 legacy=0x7f3f44150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v1:172.21.15.16:6789/0 conn(0x7f3f4406e410 legacy=0x7f3f4413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3f44070a60 con 0x7f3f280036d0 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f28008d80 con 0x7f3f28006190 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:49.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:50.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:50.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:50.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.159+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:50.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:50.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:50.563+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:51.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:51.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:51.367+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T22:20:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.951+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.951+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.951+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 reap_dead start 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f440706f0 con 0x7f3f4406e410 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3f44070a60 con 0x7f3f280036d0 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f28008d80 con 0x7f3f28006190 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:52.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:52.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:52.955+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:53.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:53.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.158+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:53.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:53.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:53.562+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:54.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:54.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:54.366+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T22:20:55.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 msgr2=0x7f3f28008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:55.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f28006190 0x7f3f28008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:55.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 msgr2=0x7f3f28005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:55.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.16:3300/0 conn(0x7f3f280036d0 0x7f3f28005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:55.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 >> v1:172.21.15.16:6789/0 conn(0x7f3f4406e410 legacy=0x7f3f2800b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2800da80 con 0x7f3f2800d560 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f3f400640 1 -- 172.21.15.16:0/1149667724 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3f44070a60 con 0x7f3f2800ca80 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:55.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:55.954+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T22:20:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.158+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.158+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.158+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.158+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:56.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.158+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T22:20:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.562+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:56.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.562+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T22:20:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.562+0000 7f3f49e00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:20:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.562+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:20:56.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:56.562+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T22:20:57.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.098+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619638237 0 0) 0x7f3f2800da80 con 0x7f3f2800d560 2024-04-26T22:20:57.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.098+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c003530 con 0x7f3f2800d560 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3904355914 0 0) 0x7f3f2c003530 con 0x7f3f2800d560 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 msgr2=0x7f3f2800ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 --2- 172.21.15.16:0/1149667724 >> v2:172.21.15.195:3300/0 conn(0x7f3f2800ca80 0x7f3f2800ce90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f28014570 con 0x7f3f2800d560 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f3f3400f040 con 0x7f3f2800d560 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 >> v1:172.21.15.195:6789/0 conn(0x7f3f2800d560 legacy=0x7f3f28011cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f4a800640 1 -- 172.21.15.16:0/1149667724 reap_dead start 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0039c0 0x7f3f2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 0x7f3f2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c0052f0 0x7f3f2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f44070a60 con 0x7f3f2c0039c0 2024-04-26T22:20:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c00c1a0 con 0x7f3f2c0052f0 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2c00c3a0 con 0x7f3f2c004810 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49e00640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0039c0 0x7f3f2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 0x7f3f2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f4a800640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c0052f0 0x7f3f2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c0052f0 msgr2=0x7f3f2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c0052f0 0x7f3f2c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0039c0 msgr2=0x7f3f2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0039c0 0x7f3f2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.102+0000 7f3f49400640 1 -- 172.21.15.16:0/1149667724 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c003530 con 0x7f3f2c004810 2024-04-26T22:20:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f49400640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 0x7f3f2c004c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f34008010 tx=0x7f3f34001920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78cd1c3fe0ea7b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34003cc0 con 0x7f3f2c004810 2024-04-26T22:20:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f340a7830 con 0x7f3f2c004810 2024-04-26T22:20:57.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f48a00640 1 -- 172.21.15.16:0/1149667724 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340a7c20 con 0x7f3f2c004810 2024-04-26T22:20:57.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 -- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 msgr2=0x7f3f2c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 0x7f3f2c004c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f34008010 tx=0x7f3f34001920 comp rx=0 tx=0).stop 2024-04-26T22:20:57.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 -- 172.21.15.16:0/1149667724 shutdown_connections 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c0052f0 0x7f3f2c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c004810 0x7f3f2c004c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 --2- 172.21.15.16:0/1149667724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0039c0 0x7f3f2c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 -- 172.21.15.16:0/1149667724 >> 172.21.15.16:0/1149667724 conn(0x7f3f440b6590 msgr2=0x7f3f440b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 -- 172.21.15.16:0/1149667724 shutdown_connections 2024-04-26T22:20:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.106+0000 7f3f4c800640 1 -- 172.21.15.16:0/1149667724 wait complete. 2024-04-26T22:20:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 Processor -- start 2024-04-26T22:20:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 -- start start 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 0x7f3f441dccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c004810 0x7f3f44072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f440b6160 con 0x7f3f2c0052f0 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3f440718a0 con 0x7f3f2c004810 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f440b62e0 con 0x7f3f2c0039c0 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f49e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 0x7f3f441dccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f49e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 0x7f3f441dccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:44094/0 (socket says 172.21.15.16:44094) 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47968/0 (socket says 172.21.15.16:47968) 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f49e00640 1 -- 172.21.15.16:0/2694330087 learned_addr learned my addr 172.21.15.16:0/2694330087 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f49400640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c004810 0x7f3f44072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 -- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 msgr2=0x7f3f441dccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 0x7f3f441dccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 -- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c004810 msgr2=0x7f3f44072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c004810 0x7f3f44072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 -- 172.21.15.16:0/2694330087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f44074190 con 0x7f3f2c0052f0 2024-04-26T22:20:57.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4a800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f440b0e10 tx=0x7f3f40013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40011980 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f40018030 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f44147950 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.110+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40011d60 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.114+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f44071fa0 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.114+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f40007460 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.114+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f4001dc10 con 0x7f3f2c0052f0 2024-04-26T22:20:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.114+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f44069530 con 0x7f3f2c0052f0 2024-04-26T22:20:57.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.126+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3f4000e040 con 0x7f3f2c0052f0 2024-04-26T22:20:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.194+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3f4413b200 con 0x7f3f2c0052f0 2024-04-26T22:20:57.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.194+0000 7f3f3e000640 1 -- 172.21.15.16:0/2694330087 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f3f400078e0 con 0x7f3f2c0052f0 2024-04-26T22:20:57.197 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-26T22:20:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 msgr2=0x7f3f4413b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3f440b0e10 tx=0x7f3f40013dc0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 shutdown_connections 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f2c0052f0 0x7f3f4413b4a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f2c004810 0x7f3f44072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 --2- 172.21.15.16:0/2694330087 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f2c0039c0 0x7f3f441dccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 >> 172.21.15.16:0/2694330087 conn(0x7f3f440b6590 msgr2=0x7f3f44145210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 shutdown_connections 2024-04-26T22:20:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:57.198+0000 7f3f4c800640 1 -- 172.21.15.16:0/2694330087 wait complete. 2024-04-26T22:20:57.218 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T22:20:57.218 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T22:20:57.218 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:57.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T22:20:57.238 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:57.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T22:20:57.304 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:57.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T22:20:57.317 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:57.315+0000 7f086944a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T22:20:57.365 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:20:57.365 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T22:20:57.428 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:57.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T22:20:57.448 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:57.448 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T22:20:57.509 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:57.509 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T22:20:57.540 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:57.538+0000 7f23bb234180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T22:20:57.569 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T22:20:57.569 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T22:20:57.629 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 73d43f67-b986-46ba-a39a-d5de48a35630 0 2024-04-26T22:20:57.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 Processor -- start 2024-04-26T22:20:57.804 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 -- start start 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 0x7f6c08149f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c0814a920 con 0x7f6c0814a490 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6c0806f500 con 0x7f6c080b8380 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c0e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c08073bf0 con 0x7f6c08073810 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c06a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 0x7f6c08149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.805 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c06a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 0x7f6c08149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38646/0 (socket says 172.21.15.195:38646) 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c06a00640 1 -- 172.21.15.195:0/3673687886 learned_addr learned my addr 172.21.15.195:0/3673687886 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55206/0 (socket says 172.21.15.195:55206) 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 -- 172.21.15.195:0/3673687886 >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 msgr2=0x7f6c08149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 --2- 172.21.15.195:0/3673687886 >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 0x7f6c08149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 -- 172.21.15.195:0/3673687886 >> v1:172.21.15.16:6789/0 conn(0x7f6c0814a490 legacy=0x7f6c080b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:57.806 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.803+0000 7f6c07400640 1 -- 172.21.15.195:0/3673687886 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c080b1030 con 0x7f6c08073810 2024-04-26T22:20:57.808 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c07400640 1 --2- 172.21.15.195:0/3673687886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80097c0 tx=0x7f6bf801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8131c66dd1162b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:57.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c06000640 1 -- 172.21.15.195:0/3673687886 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b0070 con 0x7f6c08073810 2024-04-26T22:20:57.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c06000640 1 -- 172.21.15.195:0/3673687886 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf80ab600 con 0x7f6c08073810 2024-04-26T22:20:57.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c06000640 1 -- 172.21.15.195:0/3673687886 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80ab9d0 con 0x7f6c08073810 2024-04-26T22:20:57.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 -- 172.21.15.195:0/3673687886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 msgr2=0x7f6c080b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 --2- 172.21.15.195:0/3673687886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80097c0 tx=0x7f6bf801c3a0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 -- 172.21.15.195:0/3673687886 shutdown_connections 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 --2- 172.21.15.195:0/3673687886 >> v2:172.21.15.195:3300/0 conn(0x7f6c080b8380 0x7f6c08149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 --2- 172.21.15.195:0/3673687886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c080b7e40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 -- 172.21.15.195:0/3673687886 >> 172.21.15.195:0/3673687886 conn(0x7f6c080bc570 msgr2=0x7f6c080b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 -- 172.21.15.195:0/3673687886 shutdown_connections 2024-04-26T22:20:57.810 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.807+0000 7f6c0e400640 1 -- 172.21.15.195:0/3673687886 wait complete. 2024-04-26T22:20:57.811 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 Processor -- start 2024-04-26T22:20:57.811 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- start start 2024-04-26T22:20:57.811 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f086944a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080b8380 0x7f6c0813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c0814a490 0x7f6c0813b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c08071200 con 0x7f6c0814a490 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c08071080 con 0x7f6c080b8380 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0806f730 con 0x7f6c08073810 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55214/0 (socket says 172.21.15.195:55214) 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 -- 172.21.15.195:0/1551769996 learned_addr learned my addr 172.21.15.195:0/1551769996 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c06a00640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080b8380 0x7f6c0813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07e00640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c0814a490 0x7f6c0813b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:57.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 -- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080b8380 msgr2=0x7f6c0813ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080b8380 0x7f6c0813ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 -- 172.21.15.195:0/1551769996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c0814a490 msgr2=0x7f6c0813b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c0814a490 0x7f6c0813b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 -- 172.21.15.195:0/1551769996 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0813edb0 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c07400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ae040 tx=0x7f6bf801abe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b0050 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf80bc070 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c08145ef0 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80b5870 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c080b5920 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6bf80b5a10 con 0x7f6c08073810 2024-04-26T22:20:57.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.811+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6bf80c1a40 con 0x7f6c08073810 2024-04-26T22:20:57.816 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.815+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c08069530 con 0x7f6c08073810 2024-04-26T22:20:57.821 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.819+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6bf8016050 con 0x7f6c08073810 2024-04-26T22:20:57.888 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.887+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "73d43f67-b986-46ba-a39a-d5de48a35630", "id": 0} v 0) -- 0x7f6c0806ec90 con 0x7f6c08073810 2024-04-26T22:20:57.892 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6bff400640 1 -- 172.21.15.195:0/1551769996 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73d43f67-b986-46ba-a39a-d5de48a35630", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6bf80b5df0 con 0x7f6c08073810 2024-04-26T22:20:57.892 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-04-26T22:20:57.893 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 msgr2=0x7f6c08146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:57.893 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80ae040 tx=0x7f6bf801abe0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.893 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 shutdown_connections 2024-04-26T22:20:57.893 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c0814a490 0x7f6c0813b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c080b8380 0x7f6c0813ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 --2- 172.21.15.195:0/1551769996 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c08073810 0x7f6c08146460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:57.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 >> 172.21.15.195:0/1551769996 conn(0x7f6c080bc570 msgr2=0x7f6c080bb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:57.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 shutdown_connections 2024-04-26T22:20:57.894 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:57.891+0000 7f6c0e400640 1 -- 172.21.15.195:0/1551769996 wait complete. 2024-04-26T22:20:57.911 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new e545e72a-7bbd-4d7a-823d-ca6d904bf2f6 1 2024-04-26T22:20:58.040 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.039+0000 7f086944a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T22:20:58.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 Processor -- start 2024-04-26T22:20:58.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 -- start start 2024-04-26T22:20:58.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c980a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c98073bf0 con 0x7f6c9806ff50 2024-04-26T22:20:58.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c9809fec0 con 0x7f6c98073810 2024-04-26T22:20:58.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c9d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c980a0510 con 0x7f6c98149150 2024-04-26T22:20:58.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c97400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c980a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c96a00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f6c98073810 0x7f6c980709b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:45926/0 (socket says 172.21.15.195:45926) 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.043+0000 7f6c96a00640 1 -- 172.21.15.195:0/1049193651 learned_addr learned my addr 172.21.15.195:0/1049193651 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c97400640 1 -- 172.21.15.195:0/1049193651 >> v1:172.21.15.195:6789/0 conn(0x7f6c98073810 legacy=0x7f6c980709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c96000640 1 -- 172.21.15.195:0/1049193651 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983563757 0 0) 0x7f6c9809fec0 con 0x7f6c98073810 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c97400640 1 -- 172.21.15.195:0/1049193651 >> v1:172.21.15.16:6789/0 conn(0x7f6c9806ff50 legacy=0x7f6c98148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.047 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c97400640 1 -- 172.21.15.195:0/1049193651 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c980a01a0 con 0x7f6c98149150 2024-04-26T22:20:58.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c97400640 1 --2- 172.21.15.195:0/1049193651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c980a09a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009dc0 tx=0x7f6c9001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b028d377d05a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c96000640 1 -- 172.21.15.195:0/1049193651 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900b2070 con 0x7f6c98149150 2024-04-26T22:20:58.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c96000640 1 -- 172.21.15.195:0/1049193651 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c900a5850 con 0x7f6c98149150 2024-04-26T22:20:58.050 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.047+0000 7f6c96000640 1 -- 172.21.15.195:0/1049193651 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a5c20 con 0x7f6c98149150 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- 172.21.15.195:0/1049193651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 msgr2=0x7f6c980a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1049193651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c980a09a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009dc0 tx=0x7f6c9001c990 comp rx=0 tx=0).stop 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- 172.21.15.195:0/1049193651 shutdown_connections 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1049193651 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c980a09a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- 172.21.15.195:0/1049193651 >> 172.21.15.195:0/1049193651 conn(0x7f6c980bc570 msgr2=0x7f6c980b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- 172.21.15.195:0/1049193651 shutdown_connections 2024-04-26T22:20:58.051 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- 172.21.15.195:0/1049193651 wait complete. 2024-04-26T22:20:58.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 Processor -- start 2024-04-26T22:20:58.052 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- start start 2024-04-26T22:20:58.054 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c98073810 0x7f6c98143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c98143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98156950 con 0x7f6c98073810 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6c981567d0 con 0x7f6c9806ff50 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c9d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6c98156ad0 con 0x7f6c98149150 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c97400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c98143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c97400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c98143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55240/0 (socket says 172.21.15.195:55240) 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38664/0 (socket says 172.21.15.195:38664) 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 -- 172.21.15.195:0/1344293081 learned_addr learned my addr 172.21.15.195:0/1344293081 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c8fe00640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c98073810 0x7f6c98143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 -- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 msgr2=0x7f6c98143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.055 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c98143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 -- 172.21.15.195:0/1344293081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c98073810 msgr2=0x7f6c98143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c98073810 0x7f6c98143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 -- 172.21.15.195:0/1344293081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c98144e90 con 0x7f6c9806ff50 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c96a00640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c4a0 tx=0x7f6c8800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88018070 con 0x7f6c9806ff50 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880074e0 con 0x7f6c9806ff50 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.051+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88004a30 con 0x7f6c9806ff50 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9813c750 con 0x7f6c9806ff50 2024-04-26T22:20:58.056 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c98145e80 con 0x7f6c9806ff50 2024-04-26T22:20:58.057 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c88004bd0 con 0x7f6c9806ff50 2024-04-26T22:20:58.057 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6c8801c7a0 con 0x7f6c9806ff50 2024-04-26T22:20:58.057 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c98069530 con 0x7f6c9806ff50 2024-04-26T22:20:58.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.055+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6c98144e90 con 0x7f6c9806ff50 2024-04-26T22:20:58.060 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:58.058+0000 7f23bb234180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T22:20:58.129 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.127+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e545e72a-7bbd-4d7a-823d-ca6d904bf2f6", "id": 1} v 0) -- 0x7f6c980b7280 con 0x7f6c9806ff50 2024-04-26T22:20:58.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.131+0000 7f6c8ea00640 1 -- 172.21.15.195:0/1344293081 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e545e72a-7bbd-4d7a-823d-ca6d904bf2f6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6c8801c9f0 con 0x7f6c9806ff50 2024-04-26T22:20:58.134 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-26T22:20:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 msgr2=0x7f6c9813d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c4a0 tx=0x7f6c8800c960 comp rx=0 tx=0).stop 2024-04-26T22:20:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 shutdown_connections 2024-04-26T22:20:58.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6c98149150 0x7f6c98143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c98073810 0x7f6c98143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 --2- 172.21.15.195:0/1344293081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c9806ff50 0x7f6c9813d570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 >> 172.21.15.195:0/1344293081 conn(0x7f6c980bc570 msgr2=0x7f6c9806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 shutdown_connections 2024-04-26T22:20:58.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.135+0000 7f6c9d600640 1 -- 172.21.15.195:0/1344293081 wait complete. 2024-04-26T22:20:58.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new a0827846-c13e-4061-a4a0-eb1914fef91e 2 2024-04-26T22:20:58.288 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 Processor -- start 2024-04-26T22:20:58.288 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 -- start start 2024-04-26T22:20:58.289 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed2c0683a0 0x7fed2c0a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed2c0a0d00 0x7fed2c148e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 0x7fed2c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fed2c0affb0 con 0x7fed2c0a0d00 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fed2c0b57c0 con 0x7fed2c0683a0 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed34200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c068780 con 0x7fed2c149350 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed2c0683a0 0x7fed2c0a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed2c0683a0 0x7fed2c0a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38678/0 (socket says 172.21.15.195:38678) 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed32200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 0x7fed2c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 -- 172.21.15.195:0/1185558891 learned_addr learned my addr 172.21.15.195:0/1185558891 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed30e00640 1 --2- 172.21.15.195:0/1185558891 >> v2:172.21.15.16:3300/0 conn(0x7fed2c0a0d00 0x7fed2c148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 -- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 msgr2=0x7fed2c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 0x7fed2c06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 -- 172.21.15.195:0/1185558891 >> v2:172.21.15.16:3300/0 conn(0x7fed2c0a0d00 msgr2=0x7fed2c148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:58.290 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 --2- 172.21.15.195:0/1185558891 >> v2:172.21.15.16:3300/0 conn(0x7fed2c0a0d00 0x7fed2c148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.291 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed31800640 1 -- 172.21.15.195:0/1185558891 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c0b5510 con 0x7fed2c0683a0 2024-04-26T22:20:58.291 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.287+0000 7fed32200640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 0x7fed2c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:20:58.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed31800640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0683a0 0x7fed2c0a07c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2001c140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=945cf80ef5d1c510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed2be00640 1 -- 172.21.15.195:0/1185558891 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200b0070 con 0x7fed2c0683a0 2024-04-26T22:20:58.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed2be00640 1 -- 172.21.15.195:0/1185558891 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed200ab600 con 0x7fed2c0683a0 2024-04-26T22:20:58.293 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed2be00640 1 -- 172.21.15.195:0/1185558891 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200ab9d0 con 0x7fed2c0683a0 2024-04-26T22:20:58.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 -- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0683a0 msgr2=0x7fed2c0a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0683a0 0x7fed2c0a07c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2001c140 comp rx=0 tx=0).stop 2024-04-26T22:20:58.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 -- 172.21.15.195:0/1185558891 shutdown_connections 2024-04-26T22:20:58.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c149350 0x7fed2c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.294 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 --2- 172.21.15.195:0/1185558891 >> v2:172.21.15.16:3300/0 conn(0x7fed2c0a0d00 0x7fed2c148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 --2- 172.21.15.195:0/1185558891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0683a0 0x7fed2c0a07c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 -- 172.21.15.195:0/1185558891 >> 172.21.15.195:0/1185558891 conn(0x7fed2c0bad60 msgr2=0x7fed2c0bb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 -- 172.21.15.195:0/1185558891 shutdown_connections 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.291+0000 7fed34200640 1 -- 172.21.15.195:0/1185558891 wait complete. 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 Processor -- start 2024-04-26T22:20:58.295 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- start start 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 0x7fed2c1e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c149350 0x7fed2c13c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0b7190 con 0x7fed2c149350 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0b6580 con 0x7fed2c0a0d00 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c149760 con 0x7fed2c0683a0 2024-04-26T22:20:58.298 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed30e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 0x7fed2c1e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55252/0 (socket says 172.21.15.195:55252) 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed30e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 0x7fed2c1e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38682/0 (socket says 172.21.15.195:38682) 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 -- 172.21.15.195:0/508452772 learned_addr learned my addr 172.21.15.195:0/508452772 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed32200640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c149350 0x7fed2c13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 -- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 msgr2=0x7fed2c1e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 0x7fed2c1e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 -- 172.21.15.195:0/508452772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c149350 msgr2=0x7fed2c13c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c149350 0x7fed2c13c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 -- 172.21.15.195:0/508452772 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c0ba900 con 0x7fed2c0683a0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed31800640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed200ae040 tx=0x7fed20018ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200b0040 con 0x7fed2c0683a0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed200b9070 con 0x7fed2c0683a0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200b4680 con 0x7fed2c0683a0 2024-04-26T22:20:58.299 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c147a50 con 0x7fed2c0683a0 2024-04-26T22:20:58.300 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c1482f0 con 0x7fed2c0683a0 2024-04-26T22:20:58.300 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed200b4820 con 0x7fed2c0683a0 2024-04-26T22:20:58.300 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.295+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fed200bd3c0 con 0x7fed2c0683a0 2024-04-26T22:20:58.300 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.299+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c069530 con 0x7fed2c0683a0 2024-04-26T22:20:58.301 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.299+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fed20016110 con 0x7fed2c0683a0 2024-04-26T22:20:58.316 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:58.314+0000 7f23bb234180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T22:20:58.368 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.367+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a0827846-c13e-4061-a4a0-eb1914fef91e", "id": 2} v 0) -- 0x7fed2c147770 con 0x7fed2c0683a0 2024-04-26T22:20:58.372 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed29600640 1 -- 172.21.15.195:0/508452772 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a0827846-c13e-4061-a4a0-eb1914fef91e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fed200b4b10 con 0x7fed2c0683a0 2024-04-26T22:20:58.372 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 msgr2=0x7fed2c141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed200ae040 tx=0x7fed20018ee0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 shutdown_connections 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c149350 0x7fed2c13c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed2c0a0d00 0x7fed2c1e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 --2- 172.21.15.195:0/508452772 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed2c0683a0 0x7fed2c141fc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.373 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 >> 172.21.15.195:0/508452772 conn(0x7fed2c0bad60 msgr2=0x7fed2c0b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 shutdown_connections 2024-04-26T22:20:58.374 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.371+0000 7fed34200640 1 -- 172.21.15.195:0/508452772 wait complete. 2024-04-26T22:20:58.391 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new c377631a-cda7-4b08-9179-86d40cb93428 3 2024-04-26T22:20:58.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 Processor -- start 2024-04-26T22:20:58.528 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 -- start start 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef440a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 0x7fef44148e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef440b57c0 con 0x7fef44149350 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fef440affb0 con 0x7fef440a0d00 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef4b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef44068780 con 0x7fef440683a0 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef440a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.529 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 0x7fef44148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef49200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fef44149350 0x7fef4406c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:45940/0 (socket says 172.21.15.195:45940) 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef49200640 1 -- 172.21.15.195:0/2399655593 learned_addr learned my addr 172.21.15.195:0/2399655593 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43e00640 1 -- 172.21.15.195:0/2399655593 >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 msgr2=0x7fef44148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43e00640 1 --2- 172.21.15.195:0/2399655593 >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 0x7fef44148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43e00640 1 -- 172.21.15.195:0/2399655593 >> v1:172.21.15.195:6789/0 conn(0x7fef44149350 legacy=0x7fef4406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43e00640 1 -- 172.21.15.195:0/2399655593 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef440b5510 con 0x7fef440683a0 2024-04-26T22:20:58.530 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.527+0000 7fef43400640 1 --2- 172.21.15.195:0/2399655593 >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 0x7fef44148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:20:58.532 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef43e00640 1 --2- 172.21.15.195:0/2399655593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef440a07c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fef440b5990 tx=0x7fef3401c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56dbb11f87606ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.533 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef42a00640 1 -- 172.21.15.195:0/2399655593 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340b0070 con 0x7fef440683a0 2024-04-26T22:20:58.533 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef42a00640 1 -- 172.21.15.195:0/2399655593 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef340ab400 con 0x7fef440683a0 2024-04-26T22:20:58.533 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef42a00640 1 -- 172.21.15.195:0/2399655593 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340ab7d0 con 0x7fef440683a0 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 -- 172.21.15.195:0/2399655593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 msgr2=0x7fef440a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 --2- 172.21.15.195:0/2399655593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef440a07c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fef440b5990 tx=0x7fef3401c360 comp rx=0 tx=0).stop 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 -- 172.21.15.195:0/2399655593 shutdown_connections 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 --2- 172.21.15.195:0/2399655593 >> v2:172.21.15.195:3300/0 conn(0x7fef440a0d00 0x7fef44148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 --2- 172.21.15.195:0/2399655593 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef440a07c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 -- 172.21.15.195:0/2399655593 >> 172.21.15.195:0/2399655593 conn(0x7fef440bad60 msgr2=0x7fef440bb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 -- 172.21.15.195:0/2399655593 shutdown_connections 2024-04-26T22:20:58.534 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.531+0000 7fef4b200640 1 -- 172.21.15.195:0/2399655593 wait complete. 2024-04-26T22:20:58.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 Processor -- start 2024-04-26T22:20:58.535 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- start start 2024-04-26T22:20:58.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 0x7fef4413e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef44149350 0x7fef441e4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.537 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef440b7190 con 0x7fef440a0d00 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fef440b6580 con 0x7fef44149350 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef44149760 con 0x7fef440683a0 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55262/0 (socket says 172.21.15.195:55262) 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef49200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef44149350 0x7fef441e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 -- 172.21.15.195:0/3060097641 learned_addr learned my addr 172.21.15.195:0/3060097641 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43400640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 0x7fef4413e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 -- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef44149350 msgr2=0x7fef441e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef44149350 0x7fef441e4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 -- 172.21.15.195:0/3060097641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 msgr2=0x7fef4413e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 0x7fef4413e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 -- 172.21.15.195:0/3060097641 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef440b40d0 con 0x7fef440683a0 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43400640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 0x7fef4413e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:20:58.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef43e00640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef340ae040 tx=0x7fef34019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340b8070 con 0x7fef440683a0 2024-04-26T22:20:58.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef340abd60 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340b0040 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef44147050 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef440b4c50 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.535+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fef340bb070 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.539+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fef340bd450 con 0x7fef440683a0 2024-04-26T22:20:58.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.539+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef44069530 con 0x7fef440683a0 2024-04-26T22:20:58.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.539+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fef34016070 con 0x7fef440683a0 2024-04-26T22:20:58.608 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.607+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c377631a-cda7-4b08-9179-86d40cb93428", "id": 3} v 0) -- 0x7fef44069f00 con 0x7fef440683a0 2024-04-26T22:20:58.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef3be00640 1 -- 172.21.15.195:0/3060097641 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c377631a-cda7-4b08-9179-86d40cb93428", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fef340b4650 con 0x7fef440683a0 2024-04-26T22:20:58.612 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 msgr2=0x7fef4413de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef340ae040 tx=0x7fef34019100 comp rx=0 tx=0).stop 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 shutdown_connections 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef44149350 0x7fef441e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef440a0d00 0x7fef4413e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 --2- 172.21.15.195:0/3060097641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef440683a0 0x7fef4413de40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 >> 172.21.15.195:0/3060097641 conn(0x7fef440bad60 msgr2=0x7fef440b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 shutdown_connections 2024-04-26T22:20:58.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.611+0000 7fef4b200640 1 -- 172.21.15.195:0/3060097641 wait complete. 2024-04-26T22:20:58.632 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new d8e73c75-8066-4d99-8060-21b18ecaedec 4 2024-04-26T22:20:58.683 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.683+0000 7f086944a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T22:20:58.747 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.747+0000 7f086944a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T22:20:58.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 Processor -- start 2024-04-26T22:20:58.767 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 -- start start 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbb78073810 0x7fbb780b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb78073bf0 con 0x7fbb780b8380 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbb7806f500 con 0x7fbb78073810 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb7e000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbb780b1030 con 0x7fbb7814a660 2024-04-26T22:20:58.769 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55272/0 (socket says 172.21.15.195:55272) 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 -- 172.21.15.195:0/2865520416 learned_addr learned my addr 172.21.15.195:0/2865520416 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77400640 1 --2- 172.21.15.195:0/2865520416 >> v2:172.21.15.16:3300/0 conn(0x7fbb78073810 0x7fbb780b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 -- 172.21.15.195:0/2865520416 >> v2:172.21.15.16:3300/0 conn(0x7fbb78073810 msgr2=0x7fbb780b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 --2- 172.21.15.195:0/2865520416 >> v2:172.21.15.16:3300/0 conn(0x7fbb78073810 0x7fbb780b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 -- 172.21.15.195:0/2865520416 >> v1:172.21.15.16:6789/0 conn(0x7fbb780b8380 legacy=0x7fbb78149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.770 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.767+0000 7fbb77e00640 1 -- 172.21.15.195:0/2865520416 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb78070100 con 0x7fbb7814a660 2024-04-26T22:20:58.772 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb77e00640 1 --2- 172.21.15.195:0/2865520416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009e50 tx=0x7fbb7001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420a048237351dea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.772 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb76a00640 1 -- 172.21.15.195:0/2865520416 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5850 con 0x7fbb7814a660 2024-04-26T22:20:58.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb76a00640 1 -- 172.21.15.195:0/2865520416 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb700a59f0 con 0x7fbb7814a660 2024-04-26T22:20:58.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb76a00640 1 -- 172.21.15.195:0/2865520416 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5dc0 con 0x7fbb7814a660 2024-04-26T22:20:58.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 -- 172.21.15.195:0/2865520416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 msgr2=0x7fbb78150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.773 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 --2- 172.21.15.195:0/2865520416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009e50 tx=0x7fbb7001c970 comp rx=0 tx=0).stop 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 -- 172.21.15.195:0/2865520416 shutdown_connections 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 --2- 172.21.15.195:0/2865520416 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb7814a660 0x7fbb78150d50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 --2- 172.21.15.195:0/2865520416 >> v2:172.21.15.16:3300/0 conn(0x7fbb78073810 0x7fbb780b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 -- 172.21.15.195:0/2865520416 >> 172.21.15.195:0/2865520416 conn(0x7fbb780bc570 msgr2=0x7fbb780b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 -- 172.21.15.195:0/2865520416 shutdown_connections 2024-04-26T22:20:58.774 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.771+0000 7fbb7e000640 1 -- 172.21.15.195:0/2865520416 wait complete. 2024-04-26T22:20:58.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 Processor -- start 2024-04-26T22:20:58.775 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- start start 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb780b8380 0x7fbb78141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 0x7fbb781e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7806f8b0 con 0x7fbb780b8380 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7806f730 con 0x7fbb7814a660 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7806fc70 con 0x7fbb78073810 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 0x7fbb781e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:55286/0 (socket says 172.21.15.195:55286) 2024-04-26T22:20:58.776 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77400640 1 -- 172.21.15.195:0/1453663911 learned_addr learned my addr 172.21.15.195:0/1453663911 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:58.777 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6fe00640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb780b8380 0x7fbb78141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 -- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 msgr2=0x7fbb78141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 -- 172.21.15.195:0/1453663911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb780b8380 msgr2=0x7fbb78141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb780b8380 0x7fbb78141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 -- 172.21.15.195:0/1453663911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780b3f00 con 0x7fbb7814a660 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77400640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb77e00640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 0x7fbb781e4300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb700ab000 tx=0x7fbb70019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700bc030 con 0x7fbb7814a660 2024-04-26T22:20:58.778 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb700b8470 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700b8820 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb780b5f70 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb78142500 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb700bf070 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fbb700c1690 con 0x7fbb7814a660 2024-04-26T22:20:58.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.775+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb780b4c80 con 0x7fbb7814a660 2024-04-26T22:20:58.780 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.779+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbb780b4c80 con 0x7fbb7814a660 2024-04-26T22:20:58.812 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.811+0000 7f086944a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T22:20:58.847 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.847+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8e73c75-8066-4d99-8060-21b18ecaedec", "id": 4} v 0) -- 0x7fbb78069530 con 0x7fbb7814a660 2024-04-26T22:20:58.851 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb6f400640 1 -- 172.21.15.195:0/1453663911 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8e73c75-8066-4d99-8060-21b18ecaedec", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fbb70016620 con 0x7fbb7814a660 2024-04-26T22:20:58.851 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 msgr2=0x7fbb781e4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 0x7fbb781e4300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb700ab000 tx=0x7fbb70019710 comp rx=0 tx=0).stop 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 shutdown_connections 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbb7814a660 0x7fbb781e4300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb780b8380 0x7fbb78141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 --2- 172.21.15.195:0/1453663911 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbb78073810 0x7fbb78141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:58.852 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 >> 172.21.15.195:0/1453663911 conn(0x7fbb780bc570 msgr2=0x7fbb780babe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:58.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 shutdown_connections 2024-04-26T22:20:58.853 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:58.851+0000 7fbb7e000640 1 -- 172.21.15.195:0/1453663911 wait complete. 2024-04-26T22:20:58.870 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 255b3049-89ef-4e24-961c-02ccf8d4aae7 5 2024-04-26T22:20:58.904 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.903+0000 7f086944a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T22:20:58.957 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:58.954+0000 7f23bb234180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T22:20:58.966 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:58.967+0000 7f086944a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T22:20:59.005 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.003+0000 7fed97400640 1 Processor -- start 2024-04-26T22:20:59.005 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.003+0000 7fed97400640 1 -- start start 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed97400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed90073810 0x7fed900b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed97400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed9014a660 0x7fed90150d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed97400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed90073bf0 con 0x7fed900b8380 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed97400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fed9006f500 con 0x7fed90073810 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed97400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed900b1030 con 0x7fed9014a660 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed90073810 0x7fed900b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fed90073810 0x7fed900b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38320/0 (socket says 172.21.15.195:38320) 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 -- 172.21.15.195:0/3088366859 learned_addr learned my addr 172.21.15.195:0/3088366859 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed8fe00640 1 --1- 172.21.15.195:0/3088366859 >> v1:172.21.15.195:6789/0 conn(0x7fed900b8380 0x7fed90149f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:56576/0 (socket says 172.21.15.195:56576) 2024-04-26T22:20:59.007 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed95400640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed9014a660 0x7fed90150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 -- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed9014a660 msgr2=0x7fed90150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:59.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed9014a660 0x7fed90150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 -- 172.21.15.195:0/3088366859 >> v1:172.21.15.195:6789/0 conn(0x7fed900b8380 legacy=0x7fed90149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.008 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 -- 172.21.15.195:0/3088366859 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90070100 con 0x7fed90073810 2024-04-26T22:20:59.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.007+0000 7fed94a00640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed90073810 0x7fed900b7e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed84009870 tx=0x7fed8401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476cb824c7a937e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed8f400640 1 -- 172.21.15.195:0/3088366859 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840aa620 con 0x7fed90073810 2024-04-26T22:20:59.010 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed8f400640 1 -- 172.21.15.195:0/3088366859 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed840af070 con 0x7fed90073810 2024-04-26T22:20:59.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed8f400640 1 -- 172.21.15.195:0/3088366859 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840aa9e0 con 0x7fed90073810 2024-04-26T22:20:59.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed90073810 msgr2=0x7fed900b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.011 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed90073810 0x7fed900b7e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed84009870 tx=0x7fed8401c4a0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- 172.21.15.195:0/3088366859 shutdown_connections 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed9014a660 0x7fed90150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- 172.21.15.195:0/3088366859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed90073810 0x7fed900b7e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- 172.21.15.195:0/3088366859 >> 172.21.15.195:0/3088366859 conn(0x7fed900bc570 msgr2=0x7fed900b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- 172.21.15.195:0/3088366859 shutdown_connections 2024-04-26T22:20:59.012 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- 172.21.15.195:0/3088366859 wait complete. 2024-04-26T22:20:59.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 Processor -- start 2024-04-26T22:20:59.013 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- start start 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed90073810 0x7fed900b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed900b8380 0x7fed901486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fed9006f8b0 con 0x7fed90073810 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fed9006f730 con 0x7fed9014a660 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed97400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fed9006fc70 con 0x7fed900b8380 2024-04-26T22:20:59.015 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed8fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed900b8380 0x7fed901486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:38330/0 (socket says 172.21.15.195:38330) 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 -- 172.21.15.195:0/4265818716 learned_addr learned my addr 172.21.15.195:0/4265818716 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed94a00640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed90073810 0x7fed900b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 -- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed900b8380 msgr2=0x7fed901486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed900b8380 0x7fed901486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 -- 172.21.15.195:0/4265818716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed90073810 msgr2=0x7fed900b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed90073810 0x7fed900b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.011+0000 7fed95400640 1 -- 172.21.15.195:0/4265818716 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90147f40 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed95400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fed8800efc0 tx=0x7fed8800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88018020 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88014480 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed90148220 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88014870 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed90146770 con 0x7fed9014a660 2024-04-26T22:20:59.016 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed8801b020 con 0x7fed9014a660 2024-04-26T22:20:59.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fed88013960 con 0x7fed9014a660 2024-04-26T22:20:59.017 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.015+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed90069530 con 0x7fed9014a660 2024-04-26T22:20:59.018 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.019+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fed88022070 con 0x7fed9014a660 2024-04-26T22:20:59.022 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.022+0000 7f23bb234180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T22:20:59.059 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:59.059+0000 7f086944a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T22:20:59.086 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.086+0000 7f23bb234180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T22:20:59.086 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.083+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "255b3049-89ef-4e24-961c-02ccf8d4aae7", "id": 5} v 0) -- 0x7fed900bb920 con 0x7fed9014a660 2024-04-26T22:20:59.090 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.087+0000 7fed8cc00640 1 -- 172.21.15.195:0/4265818716 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "255b3049-89ef-4e24-961c-02ccf8d4aae7", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fed88010040 con 0x7fed9014a660 2024-04-26T22:20:59.090 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-04-26T22:20:59.091 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 msgr2=0x7fed90144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fed8800efc0 tx=0x7fed8800c490 comp rx=0 tx=0).stop 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 shutdown_connections 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed9014a660 0x7fed90144090 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fed900b8380 0x7fed901486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 --2- 172.21.15.195:0/4265818716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed90073810 0x7fed900b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 >> 172.21.15.195:0/4265818716 conn(0x7fed900bc570 msgr2=0x7fed900ba880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 shutdown_connections 2024-04-26T22:20:59.092 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.091+0000 7fed97400640 1 -- 172.21.15.195:0/4265818716 wait complete. 2024-04-26T22:20:59.112 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb 6 2024-04-26T22:20:59.127 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:59.127+0000 7f086944a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T22:20:59.180 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.178+0000 7f23bb234180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T22:20:59.243 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.242+0000 7f23bb234180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T22:20:59.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 Processor -- start 2024-04-26T22:20:59.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 -- start start 2024-04-26T22:20:59.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 0x7fef880709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef88073bf0 con 0x7fef88070ef0 2024-04-26T22:20:59.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fef880a0510 con 0x7fef880a09a0 2024-04-26T22:20:59.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.259+0000 7fef90400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef880a0e00 con 0x7fef88073810 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8d000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 0x7fef880709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:42944/0 (socket says 172.21.15.195:42944) 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 -- 172.21.15.195:0/3324677682 learned_addr learned my addr 172.21.15.195:0/3324677682 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 -- 172.21.15.195:0/3324677682 >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 msgr2=0x7fef880709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 --2- 172.21.15.195:0/3324677682 >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 0x7fef880709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 -- 172.21.15.195:0/3324677682 >> v1:172.21.15.16:6789/0 conn(0x7fef88070ef0 legacy=0x7fef88148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 -- 172.21.15.195:0/3324677682 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8809fec0 con 0x7fef88073810 2024-04-26T22:20:59.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8d000640 1 --2- 172.21.15.195:0/3324677682 >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 0x7fef880709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:20:59.266 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef8da00640 1 --2- 172.21.15.195:0/3324677682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009870 tx=0x7fef7c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5aee4da63e3d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.266 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef87e00640 1 -- 172.21.15.195:0/3324677682 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0b2070 con 0x7fef88073810 2024-04-26T22:20:59.266 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef87e00640 1 -- 172.21.15.195:0/3324677682 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c0a9070 con 0x7fef88073810 2024-04-26T22:20:59.266 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.263+0000 7fef87e00640 1 -- 172.21.15.195:0/3324677682 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0ad880 con 0x7fef88073810 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- 172.21.15.195:0/3324677682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 msgr2=0x7fef8806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- 172.21.15.195:0/3324677682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009870 tx=0x7fef7c01c560 comp rx=0 tx=0).stop 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- 172.21.15.195:0/3324677682 shutdown_connections 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- 172.21.15.195:0/3324677682 >> v2:172.21.15.195:3300/0 conn(0x7fef880a09a0 0x7fef880709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- 172.21.15.195:0/3324677682 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef8806ff50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- 172.21.15.195:0/3324677682 >> 172.21.15.195:0/3324677682 conn(0x7fef880bc570 msgr2=0x7fef880b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- 172.21.15.195:0/3324677682 shutdown_connections 2024-04-26T22:20:59.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- 172.21.15.195:0/3324677682 wait complete. 2024-04-26T22:20:59.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 Processor -- start 2024-04-26T22:20:59.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- start start 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef88070ef0 0x7fef8813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 0x7fef88139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef88155940 con 0x7fef88070ef0 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fef881557c0 con 0x7fef880a09a0 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef90400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef88155ac0 con 0x7fef88073810 2024-04-26T22:20:59.271 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:42950/0 (socket says 172.21.15.195:42950) 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 -- 172.21.15.195:0/2270757040 learned_addr learned my addr 172.21.15.195:0/2270757040 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8e400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 0x7fef88139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8da00640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef88070ef0 0x7fef8813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 -- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 msgr2=0x7fef88139ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 0x7fef88139ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 -- 172.21.15.195:0/2270757040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef88070ef0 msgr2=0x7fef8813e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef88070ef0 0x7fef8813e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8d000640 1 -- 172.21.15.195:0/2270757040 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef880b7af0 con 0x7fef88073810 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.267+0000 7fef8e400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 0x7fef88139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef8d000640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e980 tx=0x7fef7400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74017070 con 0x7fef88073810 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7400ca00 con 0x7fef88073810 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7400cdd0 con 0x7fef88073810 2024-04-26T22:20:59.272 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef88142e60 con 0x7fef88073810 2024-04-26T22:20:59.273 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8814ac10 con 0x7fef88073810 2024-04-26T22:20:59.273 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fef7401a070 con 0x7fef88073810 2024-04-26T22:20:59.273 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fef74009420 con 0x7fef88073810 2024-04-26T22:20:59.273 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.271+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef880b9b60 con 0x7fef88073810 2024-04-26T22:20:59.276 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.275+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fef74005fe0 con 0x7fef88073810 2024-04-26T22:20:59.300 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:59.299+0000 7f086944a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T22:20:59.336 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.334+0000 7f23bb234180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T22:20:59.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.339+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb", "id": 6} v 0) -- 0x7fef88070ae0 con 0x7fef88073810 2024-04-26T22:20:59.346 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef85600640 1 -- 172.21.15.195:0/2270757040 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fef740064d0 con 0x7fef88073810 2024-04-26T22:20:59.346 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 msgr2=0x7fef88145030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fef7400e980 tx=0x7fef7400ee40 comp rx=0 tx=0).stop 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 shutdown_connections 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef880a09a0 0x7fef88139ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef88073810 0x7fef88145030 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 --2- 172.21.15.195:0/2270757040 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef88070ef0 0x7fef8813e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 >> 172.21.15.195:0/2270757040 conn(0x7fef880bc570 msgr2=0x7fef88146460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 shutdown_connections 2024-04-26T22:20:59.348 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.347+0000 7fef90400640 1 -- 172.21.15.195:0/2270757040 wait complete. 2024-04-26T22:20:59.366 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 5da046ca-0dc8-4408-9b92-7cddb2f94d3a 7 2024-04-26T22:20:59.374 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:20:59.375+0000 7f086944a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T22:20:59.403 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.402+0000 7f23bb234180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T22:20:59.500 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 Processor -- start 2024-04-26T22:20:59.500 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 -- start start 2024-04-26T22:20:59.501 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8384073810 0x7f83840b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.501 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8384073bf0 con 0x7f83840b8380 2024-04-26T22:20:59.501 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83840b1030 con 0x7f838414a660 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8389400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f838406f500 con 0x7f8384073810 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8382800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8384073810 0x7f83840b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8383200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f838414a660 0x7f8384150d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:56590/0 (socket says 172.21.15.195:56590) 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8383200640 1 -- 172.21.15.195:0/1420952801 learned_addr learned my addr 172.21.15.195:0/1420952801 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8382800640 1 -- 172.21.15.195:0/1420952801 >> v1:172.21.15.195:6789/0 conn(0x7f838414a660 legacy=0x7f8384150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8382800640 1 -- 172.21.15.195:0/1420952801 >> v1:172.21.15.16:6789/0 conn(0x7f83840b8380 legacy=0x7f8384149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.502 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.499+0000 7f8382800640 1 -- 172.21.15.195:0/1420952801 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8384070100 con 0x7f8384073810 2024-04-26T22:20:59.504 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8382800640 1 --2- 172.21.15.195:0/1420952801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8384073810 0x7f83840b7e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f838406f680 tx=0x7f837401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a4bf56978bf1d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.505 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8381400640 1 -- 172.21.15.195:0/1420952801 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740ab600 con 0x7f8384073810 2024-04-26T22:20:59.505 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8381400640 1 -- 172.21.15.195:0/1420952801 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83740b0070 con 0x7f8384073810 2024-04-26T22:20:59.505 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8381400640 1 -- 172.21.15.195:0/1420952801 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740ab9c0 con 0x7f8384073810 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 -- 172.21.15.195:0/1420952801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8384073810 msgr2=0x7f83840b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 --2- 172.21.15.195:0/1420952801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8384073810 0x7f83840b7e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f838406f680 tx=0x7f837401c3e0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 -- 172.21.15.195:0/1420952801 shutdown_connections 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 --2- 172.21.15.195:0/1420952801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8384073810 0x7f83840b7e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 -- 172.21.15.195:0/1420952801 >> 172.21.15.195:0/1420952801 conn(0x7f83840bc570 msgr2=0x7f83840b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 -- 172.21.15.195:0/1420952801 shutdown_connections 2024-04-26T22:20:59.506 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.503+0000 7f8389400640 1 -- 172.21.15.195:0/1420952801 wait complete. 2024-04-26T22:20:59.507 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 Processor -- start 2024-04-26T22:20:59.507 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- start start 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8384073810 0x7f8384148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f838414a660 0x7f838409e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f838406f8b0 con 0x7f8384073810 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f838406f730 con 0x7f838414a660 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f838406fc70 con 0x7f83840b8380 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8383200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f838414a660 0x7f838409e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8382800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8384073810 0x7f8384148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:42954/0 (socket says 172.21.15.195:42954) 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 -- 172.21.15.195:0/3247702422 learned_addr learned my addr 172.21.15.195:0/3247702422 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-04-26T22:20:59.510 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 -- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f838414a660 msgr2=0x7f838409e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f838414a660 0x7f838409e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 -- 172.21.15.195:0/3247702422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8384073810 msgr2=0x7f8384148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8384073810 0x7f8384148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 -- 172.21.15.195:0/3247702422 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83840b2b50 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8381e00640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f837000c420 tx=0x7f837000c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83700052d0 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370005470 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370007260 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83840a0690 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f838409ed40 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8370007400 con 0x7f83840b8380 2024-04-26T22:20:59.511 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.507+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8370003a10 con 0x7f83840b8380 2024-04-26T22:20:59.512 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.511+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8384069530 con 0x7f83840b8380 2024-04-26T22:20:59.512 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.511+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8370003600 con 0x7f83840b8380 2024-04-26T22:20:59.576 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.574+0000 7f23bb234180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T22:20:59.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.575+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5da046ca-0dc8-4408-9b92-7cddb2f94d3a", "id": 7} v 0) -- 0x7f83840b72d0 con 0x7f83840b8380 2024-04-26T22:20:59.582 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f837aa00640 1 -- 172.21.15.195:0/3247702422 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5da046ca-0dc8-4408-9b92-7cddb2f94d3a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8370003cf0 con 0x7f83840b8380 2024-04-26T22:20:59.582 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 msgr2=0x7f838409db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f837000c420 tx=0x7f837000c8e0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 shutdown_connections 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f838414a660 0x7f838409e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f83840b8380 0x7f838409db70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 --2- 172.21.15.195:0/3247702422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8384073810 0x7f8384148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 >> 172.21.15.195:0/3247702422 conn(0x7f83840bc570 msgr2=0x7f83840b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 shutdown_connections 2024-04-26T22:20:59.584 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T22:20:59.583+0000 7f8389400640 1 -- 172.21.15.195:0/3247702422 wait complete. 2024-04-26T22:20:59.602 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T22:20:59.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T22:20:59.605 INFO:tasks.ceph.osd.0:Started 2024-04-26T22:20:59.606 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T22:20:59.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T22:20:59.609 INFO:tasks.ceph.osd.1:Started 2024-04-26T22:20:59.609 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T22:20:59.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T22:20:59.612 INFO:tasks.ceph.osd.2:Started 2024-04-26T22:20:59.612 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T22:20:59.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T22:20:59.616 INFO:tasks.ceph.osd.3:Started 2024-04-26T22:20:59.616 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T22:20:59.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T22:20:59.648 INFO:tasks.ceph.osd.4:Started 2024-04-26T22:20:59.649 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T22:20:59.649 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T22:20:59.651 INFO:tasks.ceph.osd.5:Started 2024-04-26T22:20:59.652 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T22:20:59.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T22:20:59.654 INFO:tasks.ceph.osd.6:Started 2024-04-26T22:20:59.655 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T22:20:59.655 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T22:20:59.658 INFO:tasks.ceph.osd.7:Started 2024-04-26T22:20:59.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:20:59.675 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:20:59.674+0000 7f23bb234180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T22:20:59.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.814+0000 7fdccce00640 1 Processor -- start 2024-04-26T22:20:59.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.814+0000 7fdccce00640 1 -- start start 2024-04-26T22:20:59.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdcc80b8680 0x7fdcc8146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcc8073d90 0x7fdcc8140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc80b66c0 0x7fdcc81406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc80b6b80 con 0x7fdcc8073d90 2024-04-26T22:20:59.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc814a210 con 0x7fdcc80b8680 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdccce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc80b8dd0 con 0x7fdcc80b66c0 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcc8073d90 0x7fdcc8140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcc8073d90 0x7fdcc8140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47998/0 (socket says 172.21.15.16:47998) 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 -- 172.21.15.16:0/1720759101 learned_addr learned my addr 172.21.15.16:0/1720759101 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5e00640 1 --2- 172.21.15.16:0/1720759101 >> v2:172.21.15.195:3300/0 conn(0x7fdcc80b8680 0x7fdcc8146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc6800640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc80b66c0 0x7fdcc81406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 -- 172.21.15.16:0/1720759101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc80b66c0 msgr2=0x7fdcc81406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc80b66c0 0x7fdcc81406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 -- 172.21.15.16:0/1720759101 >> v2:172.21.15.195:3300/0 conn(0x7fdcc80b8680 msgr2=0x7fdcc8146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 --2- 172.21.15.16:0/1720759101 >> v2:172.21.15.195:3300/0 conn(0x7fdcc80b8680 0x7fdcc8146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.818+0000 7fdcc5400640 1 -- 172.21.15.16:0/1720759101 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc8149ea0 con 0x7fdcc8073d90 2024-04-26T22:20:59.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdcc5400640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc8073d90 0x7fdcc8140170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80b9880 tx=0x7fdcb401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f70b2b6e22d30f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdcc4a00640 1 -- 172.21.15.16:0/1720759101 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40b0070 con 0x7fdcc8073d90 2024-04-26T22:20:59.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdcc4a00640 1 -- 172.21.15.16:0/1720759101 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb40ab600 con 0x7fdcc8073d90 2024-04-26T22:20:59.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdcc4a00640 1 -- 172.21.15.16:0/1720759101 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40ab9d0 con 0x7fdcc8073d90 2024-04-26T22:20:59.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- 172.21.15.16:0/1720759101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc8073d90 msgr2=0x7fdcc8140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc8073d90 0x7fdcc8140170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80b9880 tx=0x7fdcb401c490 comp rx=0 tx=0).stop 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- 172.21.15.16:0/1720759101 shutdown_connections 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc80b66c0 0x7fdcc81406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 --2- 172.21.15.16:0/1720759101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc8073d90 0x7fdcc8140170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 --2- 172.21.15.16:0/1720759101 >> v2:172.21.15.195:3300/0 conn(0x7fdcc80b8680 0x7fdcc8146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- 172.21.15.16:0/1720759101 >> 172.21.15.16:0/1720759101 conn(0x7fdcc806f3d0 msgr2=0x7fdcc806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- 172.21.15.16:0/1720759101 shutdown_connections 2024-04-26T22:20:59.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- 172.21.15.16:0/1720759101 wait complete. 2024-04-26T22:20:59.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 Processor -- start 2024-04-26T22:20:59.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 -- start start 2024-04-26T22:20:59.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.822+0000 7fdccce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 0x7fdcc81e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc80b8680 0x7fdcc806c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:20:59.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8146a40 con 0x7fdcc80b66c0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc81468c0 con 0x7fdcc80b8680 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc8072e20 con 0x7fdcc8073d90 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48000/0 (socket says 172.21.15.16:48000) 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 -- 172.21.15.16:0/3429662152 learned_addr learned my addr 172.21.15.16:0/3429662152 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc6800640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc80b8680 0x7fdcc806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5e00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 0x7fdcc81e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 -- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 msgr2=0x7fdcc81e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 0x7fdcc81e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 -- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc80b8680 msgr2=0x7fdcc806c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc80b8680 0x7fdcc806c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 -- 172.21.15.16:0/3429662152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc806da80 con 0x7fdcc80b66c0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5e00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 0x7fdcc81e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcc5400640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40ae040 tx=0x7fdcb4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:20:59.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40b0040 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb40b4420 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40b47f0 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc81484c0 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc806c400 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdcb40b4990 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdcb40b4c80 con 0x7fdcc80b66c0 2024-04-26T22:20:59.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.826+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc81482b0 con 0x7fdcc80b66c0 2024-04-26T22:20:59.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.830+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fdcb4016110 con 0x7fdcc80b66c0 2024-04-26T22:20:59.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.886+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdcc8069530 con 0x7fdcc80b66c0 2024-04-26T22:20:59.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdcbe000640 1 -- 172.21.15.16:0/3429662152 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdcb40bd400 con 0x7fdcc80b66c0 2024-04-26T22:20:59.890 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:20:59.890 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:20:59.582829+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:20:59.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 msgr2=0x7fdcc806d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:20:59.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40ae040 tx=0x7fdcb4019230 comp rx=0 tx=0).stop 2024-04-26T22:20:59.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 shutdown_connections 2024-04-26T22:20:59.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdcc80b8680 0x7fdcc806c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc80b66c0 0x7fdcc806d3a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 --2- 172.21.15.16:0/3429662152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdcc8073d90 0x7fdcc81e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:20:59.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 >> 172.21.15.16:0/3429662152 conn(0x7fdcc806f3d0 msgr2=0x7fdcc80babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:20:59.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 shutdown_connections 2024-04-26T22:20:59.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:20:59.890+0000 7fdccce00640 1 -- 172.21.15.16:0/3429662152 wait complete. 2024-04-26T22:20:59.910 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T22:20:59.910 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T22:21:00.032 INFO:tasks.ceph.mgr.x.smithi195.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T22:21:00.032 INFO:tasks.ceph.mgr.x.smithi195.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T22:21:00.032 INFO:tasks.ceph.mgr.x.smithi195.stderr: from numpy import show_config as show_numpy_config 2024-04-26T22:21:00.074 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:00.071+0000 7f086944a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T22:21:00.223 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:00.223+0000 7f086944a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T22:21:00.275 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T22:21:00.274+0000 7fb46858f7c0 -1 Falling back to public interface 2024-04-26T22:21:00.283 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T22:21:00.282+0000 7facbce127c0 -1 Falling back to public interface 2024-04-26T22:21:00.290 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T22:21:00.290+0000 7fa42d2a97c0 -1 Falling back to public interface 2024-04-26T22:21:00.315 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-26T22:21:00.315+0000 7f3c25e487c0 -1 Falling back to public interface 2024-04-26T22:21:00.319 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T22:21:00.318+0000 7f467ea047c0 -1 Falling back to public interface 2024-04-26T22:21:00.335 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-26T22:21:00.335+0000 7f23242ab7c0 -1 Falling back to public interface 2024-04-26T22:21:00.349 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T22:21:00.349 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T22:21:00.349 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-04-26T22:21:00.371 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-26T22:21:00.371+0000 7f14926c17c0 -1 Falling back to public interface 2024-04-26T22:21:00.372 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-26T22:21:00.371+0000 7f4f78b017c0 -1 Falling back to public interface 2024-04-26T22:21:00.390 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:00.387+0000 7f086944a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T22:21:00.396 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:00.394+0000 7f23bb234180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T22:21:00.464 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:00.463+0000 7f086944a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T22:21:00.552 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:00.550+0000 7f23bb234180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T22:21:00.613 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:00.611+0000 7f086944a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T22:21:00.716 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:00.747 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:00.746+0000 7f23bb234180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T22:21:00.825 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:00.822+0000 7f23bb234180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T22:21:00.847 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 Processor -- start 2024-04-26T22:21:00.847 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 -- start start 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fad680af0f0 0x7fad68151020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680b1400 con 0x7fad6806d6f0 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680b5580 con 0x7fad680afd70 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad6dc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fad680b3c30 con 0x7fad680af0f0 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad67400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fad680af0f0 0x7fad68151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad66a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fad6806d6f0 0x7fad680b4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60420/0 (socket says 172.21.15.16:60420) 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad66a00640 1 -- 172.21.15.16:0/2125390403 learned_addr learned my addr 172.21.15.16:0/2125390403 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010839217 0 0) 0x7fad680b1400 con 0x7fad6806d6f0 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad4c003530 con 0x7fad6806d6f0 2024-04-26T22:21:00.849 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799370979 0 0) 0x7fad680b5580 con 0x7fad680afd70 2024-04-26T22:21:00.850 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad67400640 1 -- 172.21.15.16:0/2125390403 >> v1:172.21.15.195:6789/0 conn(0x7fad680afd70 legacy=0x7fad680b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.850 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad67400640 1 -- 172.21.15.16:0/2125390403 >> v1:172.21.15.16:6789/0 conn(0x7fad6806d6f0 legacy=0x7fad680b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.850 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.846+0000 7fad67400640 1 -- 172.21.15.16:0/2125390403 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6806dad0 con 0x7fad680af0f0 2024-04-26T22:21:00.853 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.850+0000 7fad67400640 1 --2- 172.21.15.16:0/2125390403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680af0f0 0x7fad68151020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad60009dc0 tx=0x7fad6001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebbe13a26928930 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:00.854 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600b2070 con 0x7fad680af0f0 2024-04-26T22:21:00.854 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad600a5800 con 0x7fad680af0f0 2024-04-26T22:21:00.854 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad66000640 1 -- 172.21.15.16:0/2125390403 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600a5bd0 con 0x7fad680af0f0 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- 172.21.15.16:0/2125390403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680af0f0 msgr2=0x7fad68151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2125390403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680af0f0 0x7fad68151020 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad60009dc0 tx=0x7fad6001c830 comp rx=0 tx=0).stop 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- 172.21.15.16:0/2125390403 shutdown_connections 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2125390403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680af0f0 0x7fad68151020 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- 172.21.15.16:0/2125390403 >> 172.21.15.16:0/2125390403 conn(0x7fad680b9d60 msgr2=0x7fad680ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- 172.21.15.16:0/2125390403 shutdown_connections 2024-04-26T22:21:00.855 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- 172.21.15.16:0/2125390403 wait complete. 2024-04-26T22:21:00.856 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 Processor -- start 2024-04-26T22:21:00.856 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- start start 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 0x7fad68140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fad680b1670 con 0x7fad680afd70 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fad680b4160 con 0x7fad680af0f0 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad6dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fad680af830 con 0x7fad6806d6f0 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad67400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad66a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad67400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48006/0 (socket says 172.21.15.16:48006) 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad5e000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 0x7fad68140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:00.858 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad67400640 1 -- 172.21.15.16:0/2061174696 learned_addr learned my addr 172.21.15.16:0/2061174696 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:00.859 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.854+0000 7fad66a00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:44154/0 (socket says 172.21.15.16:44154) 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 -- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 msgr2=0x7fad68146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 -- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 msgr2=0x7fad68140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 0x7fad68140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 -- 172.21.15.16:0/2061174696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6814a1c0 con 0x7fad680afd70 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad66a00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:00.860 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5e000640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 0x7fad68140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad67400640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad6001cd10 tx=0x7fad600195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600b2050 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad600be070 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad681502b0 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad600ad870 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad68150550 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad600ada10 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fad600add00 con 0x7fad680afd70 2024-04-26T22:21:00.861 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.858+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad68069d80 con 0x7fad680afd70 2024-04-26T22:21:00.862 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.862+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fad60016540 con 0x7fad680afd70 2024-04-26T22:21:00.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.918+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad68076400 con 0x7fad680afd70 2024-04-26T22:21:00.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad5f400640 1 -- 172.21.15.16:0/2061174696 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fad600c3460 con 0x7fad680afd70 2024-04-26T22:21:00.923 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T22:21:00.923 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:20:59.582829+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 msgr2=0x7fad68141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad6001cd10 tx=0x7fad600195d0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 shutdown_connections 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad680afd70 0x7fad68141140 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad680af0f0 0x7fad68140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 --2- 172.21.15.16:0/2061174696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fad6806d6f0 0x7fad68146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 >> 172.21.15.16:0/2061174696 conn(0x7fad680b9d60 msgr2=0x7fad680b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 shutdown_connections 2024-04-26T22:21:00.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:00.922+0000 7fad6dc00640 1 -- 172.21.15.16:0/2061174696 wait complete. 2024-04-26T22:21:00.941 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T22:21:00.991 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:00.990+0000 7f23bb234180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T22:21:01.310 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:01.311+0000 7f086944a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T22:21:01.397 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:01.395+0000 7f086944a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T22:21:01.599 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:01.599+0000 7f086944a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T22:21:01.684 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:01.683+0000 7f086944a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T22:21:01.718 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:01.718+0000 7f23bb234180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T22:21:01.809 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:01.806+0000 7f23bb234180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T22:21:02.012 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:02.011+0000 7f086944a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T22:21:02.023 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:02.022+0000 7f23bb234180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T22:21:02.083 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:02.083+0000 7f086944a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T22:21:02.114 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:02.114+0000 7f23bb234180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T22:21:02.465 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:02.461+0000 7f23bb234180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T22:21:02.540 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T22:21:02.537+0000 7f23bb234180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T22:21:03.126 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:03.123+0000 7f080e000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T22:21:03.126 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-04-26T22:21:03.123+0000 7f080e000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T22:21:04.103 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T22:21:04.101+0000 7fb46858f7c0 -1 osd.0 0 log_to_monitors true 2024-04-26T22:21:04.207 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-26T22:21:04.207+0000 7f23242ab7c0 -1 osd.7 0 log_to_monitors true 2024-04-26T22:21:04.227 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T22:21:04.225+0000 7facbce127c0 -1 osd.1 0 log_to_monitors true 2024-04-26T22:21:04.294 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-26T22:21:04.291+0000 7f3c25e487c0 -1 osd.5 0 log_to_monitors true 2024-04-26T22:21:04.336 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T22:21:04.333+0000 7fa42d2a97c0 -1 osd.2 0 log_to_monitors true 2024-04-26T22:21:04.357 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T22:21:04.353+0000 7f467ea047c0 -1 osd.3 0 log_to_monitors true 2024-04-26T22:21:04.369 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-26T22:21:04.367+0000 7f14926c17c0 -1 osd.4 0 log_to_monitors true 2024-04-26T22:21:04.387 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-26T22:21:04.387+0000 7f4f78b017c0 -1 osd.6 0 log_to_monitors true 2024-04-26T22:21:06.125 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T22:21:06.121+0000 7fb463400640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T22:21:06.149 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T22:21:06.145+0000 7fb459400640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.600 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T22:21:07.601+0000 7facb7c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T22:21:07.613 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T22:21:07.613+0000 7fa428200640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T22:21:07.632 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T22:21:07.633+0000 7facadc00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.647 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T22:21:07.649+0000 7fa41e200640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.666 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T22:21:07.665+0000 7f4679800640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T22:21:07.703 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T22:21:07.705+0000 7f466f800640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.747 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:07.766 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-26T22:21:07.763+0000 7f231f200640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T22:21:07.800 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-04-26T22:21:07.799+0000 7f2315200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.803 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-26T22:21:07.803+0000 7f148e000640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T22:21:07.810 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-26T22:21:07.807+0000 7f3c20e00640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T22:21:07.814 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-26T22:21:07.811+0000 7f4f74400640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T22:21:07.831 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-04-26T22:21:07.831+0000 7f1483600640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.844 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-04-26T22:21:07.843+0000 7f3c16e00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.844 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-04-26T22:21:07.843+0000 7f4f69a00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T22:21:07.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.877+0000 7fdb50600640 1 Processor -- start 2024-04-26T22:21:07.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.877+0000 7fdb50600640 1 -- start start 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb50600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb4806d6f0 0x7fdb480afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb50600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb480b4e70 0x7fdb48150010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb50600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb480b1400 con 0x7fdb480af0f0 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb50600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdb480b3c30 con 0x7fdb4806d6f0 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb50600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdb480b4160 con 0x7fdb480b4e70 2024-04-26T22:21:07.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb4806d6f0 0x7fdb480afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb4806d6f0 0x7fdb480afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54376/0 (socket says 172.21.15.16:54376) 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 -- 172.21.15.16:0/2039205681 learned_addr learned my addr 172.21.15.16:0/2039205681 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4e600640 1 --2- 172.21.15.16:0/2039205681 >> v2:172.21.15.195:3300/0 conn(0x7fdb480b4e70 0x7fdb48150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 -- 172.21.15.16:0/2039205681 >> v2:172.21.15.195:3300/0 conn(0x7fdb480b4e70 msgr2=0x7fdb48150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 --2- 172.21.15.16:0/2039205681 >> v2:172.21.15.195:3300/0 conn(0x7fdb480b4e70 0x7fdb48150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 -- 172.21.15.16:0/2039205681 >> v1:172.21.15.195:6789/0 conn(0x7fdb480af0f0 legacy=0x7fdb480b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:07.880 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.881+0000 7fdb4dc00640 1 -- 172.21.15.16:0/2039205681 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4806dad0 con 0x7fdb4806d6f0 2024-04-26T22:21:07.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4dc00640 1 --2- 172.21.15.16:0/2039205681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb4806d6f0 0x7fdb480afd70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb480b39b0 tx=0x7fdb3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad7ae9ee0b59d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:07.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb47e00640 1 -- 172.21.15.16:0/2039205681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0b0070 con 0x7fdb4806d6f0 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb47e00640 1 -- 172.21.15.16:0/2039205681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c0ab600 con 0x7fdb4806d6f0 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb47e00640 1 -- 172.21.15.16:0/2039205681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0ab9d0 con 0x7fdb4806d6f0 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- 172.21.15.16:0/2039205681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb4806d6f0 msgr2=0x7fdb480afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- 172.21.15.16:0/2039205681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb4806d6f0 0x7fdb480afd70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdb480b39b0 tx=0x7fdb3c01c400 comp rx=0 tx=0).stop 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- 172.21.15.16:0/2039205681 shutdown_connections 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- 172.21.15.16:0/2039205681 >> v2:172.21.15.195:3300/0 conn(0x7fdb480b4e70 0x7fdb48150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- 172.21.15.16:0/2039205681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb4806d6f0 0x7fdb480afd70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- 172.21.15.16:0/2039205681 >> 172.21.15.16:0/2039205681 conn(0x7fdb480b9d60 msgr2=0x7fdb480ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- 172.21.15.16:0/2039205681 shutdown_connections 2024-04-26T22:21:07.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- 172.21.15.16:0/2039205681 wait complete. 2024-04-26T22:21:07.885 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 Processor -- start 2024-04-26T22:21:07.885 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- start start 2024-04-26T22:21:07.887 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb4806d6f0 0x7fdb4814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.887 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 0x7fdb481e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.887 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.887 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb480af9b0 con 0x7fdb480b4e70 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdb480af830 con 0x7fdb4806d6f0 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb50600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb48152d70 con 0x7fdb480af0f0 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54380/0 (socket says 172.21.15.16:54380) 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4e600640 1 -- 172.21.15.16:0/249187008 learned_addr learned my addr 172.21.15.16:0/249187008 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4dc00640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb4806d6f0 0x7fdb4814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.885+0000 7fdb4d200640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 0x7fdb481e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 -- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 msgr2=0x7fdb481e17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 0x7fdb481e17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 -- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb4806d6f0 msgr2=0x7fdb4814d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb4806d6f0 0x7fdb4814d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:07.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 -- 172.21.15.16:0/249187008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4814f7b0 con 0x7fdb480b4e70 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4d200640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 0x7fdb481e17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4e600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000ec40 tx=0x7fdb4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40018020 con 0x7fdb480b4e70 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4000ee50 con 0x7fdb480b4e70 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb48148310 con 0x7fdb480b4e70 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400146c0 con 0x7fdb480b4e70 2024-04-26T22:21:07.889 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4814e3f0 con 0x7fdb480b4e70 2024-04-26T22:21:07.890 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb48069d80 con 0x7fdb480b4e70 2024-04-26T22:21:07.890 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fdb4001b020 con 0x7fdb480b4e70 2024-04-26T22:21:07.890 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 0x7fdb2806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:07.890 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7fdb400864e0 con 0x7fdb480b4e70 2024-04-26T22:21:07.890 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.889+0000 7fdb4dc00640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 0x7fdb2806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:07.891 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.893+0000 7fdb4dc00640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 0x7fdb2806a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0ad000 tx=0x7fdb3c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:07.895 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:07.897+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb40022070 con 0x7fdb480b4e70 2024-04-26T22:21:08.061 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.061+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb481492b0 con 0x7fdb480b4e70 2024-04-26T22:21:08.062 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.061+0000 7fdb45600640 1 -- 172.21.15.16:0/249187008 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7fdb40010040 con 0x7fdb480b4e70 2024-04-26T22:21:08.062 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T22:21:08.062 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":14,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:07.153071+0000","last_up_change":"2024-04-26T22:21:07.153071+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 msgr2=0x7fdb2806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 0x7fdb2806a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0ad000 tx=0x7fdb3c0a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 msgr2=0x7fdb481e1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000ec40 tx=0x7fdb4000c490 comp rx=0 tx=0).stop 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 shutdown_connections 2024-04-26T22:21:08.064 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb280682f0 0x7fdb2806a7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb480b4e70 0x7fdb481e1d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb480af0f0 0x7fdb481e17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 --2- 172.21.15.16:0/249187008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb4806d6f0 0x7fdb4814d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 >> 172.21.15.16:0/249187008 conn(0x7fdb480b9d60 msgr2=0x7fdb4806e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 shutdown_connections 2024-04-26T22:21:08.065 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:08.065+0000 7fdb50600640 1 -- 172.21.15.16:0/249187008 wait complete. 2024-04-26T22:21:08.080 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-26T22:21:14.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:21:14.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:21:14.887 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:15.029 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 Processor -- start 2024-04-26T22:21:15.029 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 -- start start 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f82000b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f82000b3440 0x7f8200149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82000b2a70 con 0x7f820014a100 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f82000b3880 con 0x7f82000b3440 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8206e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f82000b18a0 con 0x7f82000b14c0 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8204e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f820014a100 0x7f820006d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52136/0 (socket says 172.21.15.16:52136) 2024-04-26T22:21:15.030 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f8204e00640 1 -- 172.21.15.16:0/1979096277 learned_addr learned my addr 172.21.15.16:0/1979096277 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:15.032 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020122987 0 0) 0x7f81f80014a0 con 0x7f820014a100 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f81ffe00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f82000b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e4003530 con 0x7f820014a100 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.029+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1979096277 >> v2:172.21.15.195:3300/0 conn(0x7f82000b3440 0x7f8200149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4197332008 0 0) 0x7f81e4003530 con 0x7f820014a100 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 msgr2=0x7f82000b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f82000b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 >> v2:172.21.15.195:3300/0 conn(0x7f82000b3440 msgr2=0x7f8200149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 --2- 172.21.15.16:0/1979096277 >> v2:172.21.15.195:3300/0 conn(0x7f82000b3440 0x7f8200149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8200074110 con 0x7f820014a100 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f81f8001bd0 con 0x7f820014a100 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 >> v1:172.21.15.16:6789/0 conn(0x7f820014a100 legacy=0x7f820006d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f81e40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e4003f40 0x7f81e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.033 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e4004d50 0x7f81e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f82000b3880 con 0x7f81e4003f40 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f82000b18a0 con 0x7f81e4004d50 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f81e400ba20 con 0x7f82000b14c0 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e4003f40 0x7f81e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81ffe00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f81e40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f8204e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e4004d50 0x7f81e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 -- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 msgr2=0x7f81e40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82000b14c0 0x7f81e40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.034 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 -- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e4004d50 msgr2=0x7f81e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.035 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e4004d50 0x7f81e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.035 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 -- 172.21.15.16:0/1979096277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e4003530 con 0x7f81e4003f40 2024-04-26T22:21:15.035 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f8204e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81e4004d50 0x7f81e40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:15.036 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.033+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e4003f40 0x7f81e4004810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009b10 tx=0x7f81e801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425227b9b614b2bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.036 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80096b0 con 0x7f81e4003f40 2024-04-26T22:21:15.036 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e80a6490 con 0x7f81e4003f40 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81ff400640 1 -- 172.21.15.16:0/1979096277 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80a6880 con 0x7f81e4003f40 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- 172.21.15.16:0/1979096277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e4003f40 msgr2=0x7f81e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 --2- 172.21.15.16:0/1979096277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81e4003f40 0x7f81e4004810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009b10 tx=0x7f81e801cab0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8204e00640 1 -- 172.21.15.16:0/1979096277 reap_dead start 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- 172.21.15.16:0/1979096277 shutdown_connections 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- 172.21.15.16:0/1979096277 >> 172.21.15.16:0/1979096277 conn(0x7f82000b9d60 msgr2=0x7f82000ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- 172.21.15.16:0/1979096277 shutdown_connections 2024-04-26T22:21:15.037 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- 172.21.15.16:0/1979096277 wait complete. 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 Processor -- start 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- start start 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e4003f40 0x7f82001d2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82001e1540 0x7f82001e19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f820014a920 con 0x7f82001d3040 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f820006e740 con 0x7f82001e1540 2024-04-26T22:21:15.040 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8206e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f82000b64f0 con 0x7f81e4003f40 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55898/0 (socket says 172.21.15.16:55898) 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81f7e00640 1 -- 172.21.15.16:0/1607044641 learned_addr learned my addr 172.21.15.16:0/1607044641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f81ffe00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e4003f40 0x7f82001d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.037+0000 7f8204e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82001e1540 0x7f82001e19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 -- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e4003f40 msgr2=0x7f82001d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e4003f40 0x7f82001d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 -- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82001e1540 msgr2=0x7f82001e19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82001e1540 0x7f82001e19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 -- 172.21.15.16:0/1607044641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820009d540 con 0x7f82001d3040 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81f7e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81e801c8e0 tx=0x7f81e8019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.041 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80a6c40 con 0x7f82001d3040 2024-04-26T22:21:15.042 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e80a6de0 con 0x7f82001d3040 2024-04-26T22:21:15.042 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80a7690 con 0x7f82001d3040 2024-04-26T22:21:15.042 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82001d3ae0 con 0x7f82001d3040 2024-04-26T22:21:15.042 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820009e5c0 con 0x7f82001d3040 2024-04-26T22:21:15.042 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8200069d80 con 0x7f82001d3040 2024-04-26T22:21:15.043 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.041+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81e80a7830 con 0x7f82001d3040 2024-04-26T22:21:15.043 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.045+0000 7f81fcc00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.043 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.045+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f81e8120810 con 0x7f82001d3040 2024-04-26T22:21:15.043 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.045+0000 7f81ffe00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.044 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.045+0000 7f81ffe00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 0x7f81dc06a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009a40 tx=0x7f81f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.048 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.049+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f81e80c3030 con 0x7f82001d3040 2024-04-26T22:21:15.214 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.213+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82000afee0 con 0x7f82001d3040 2024-04-26T22:21:15.215 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.213+0000 7f81fcc00640 1 -- 172.21.15.16:0/1607044641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12872 (secure 0 0 0) 0x7f81e80ac020 con 0x7f82001d3040 2024-04-26T22:21:15.215 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T22:21:15.215 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":18,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:12.155194+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 msgr2=0x7f81dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 0x7f81dc06a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009a40 tx=0x7f81f0008040 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 msgr2=0x7f82001d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f81e801c8e0 tx=0x7f81e8019850 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 shutdown_connections 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81dc068380 0x7f81dc06a840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82001e1540 0x7f82001e19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82001d3040 0x7f82001d3480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 --2- 172.21.15.16:0/1607044641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f81e4003f40 0x7f82001d2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 >> 172.21.15.16:0/1607044641 conn(0x7f82000b9d60 msgr2=0x7f8200146510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 shutdown_connections 2024-04-26T22:21:15.217 INFO:teuthology.misc.health.smithi016.stderr:2024-04-26T22:21:15.217+0000 7f8206e00640 1 -- 172.21.15.16:0/1607044641 wait complete. 2024-04-26T22:21:15.234 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T22:21:15.234 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T22:21:15.235 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:21:15.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:21:15.238 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:21:15.238 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:21:15.238 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:21:15.242 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:21:15.242 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T22:21:15.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:15.338 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T22:21:15.345 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-26T22:21:15.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 Processor -- start 2024-04-26T22:21:15.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 -- start start 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb440b8680 0x7fdb44146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb44073d90 0x7fdb44140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb440b8dd0 con 0x7fdb440b66c0 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdb440b6b80 con 0x7fdb44073d90 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb49800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4414a210 con 0x7fdb440b8680 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb44073d90 0x7fdb44140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb44073d90 0x7fdb44140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55918/0 (socket says 172.21.15.16:55918) 2024-04-26T22:21:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 -- 172.21.15.16:0/3807217001 learned_addr learned my addr 172.21.15.16:0/3807217001 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:15.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb42a00640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb440b8680 0x7fdb44146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 -- 172.21.15.16:0/3807217001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb440b8680 msgr2=0x7fdb44146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb440b8680 0x7fdb44146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.384+0000 7fdb3be00640 1 -- 172.21.15.16:0/3807217001 >> v1:172.21.15.195:6789/0 conn(0x7fdb440b66c0 legacy=0x7fdb44072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb3be00640 1 -- 172.21.15.16:0/3807217001 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44149ea0 con 0x7fdb44073d90 2024-04-26T22:21:15.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb3be00640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb44073d90 0x7fdb44140170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ba889731d4cf76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb42000640 1 -- 172.21.15.16:0/3807217001 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b0070 con 0x7fdb44073d90 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb42000640 1 -- 172.21.15.16:0/3807217001 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0ab600 con 0x7fdb44073d90 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb42000640 1 -- 172.21.15.16:0/3807217001 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0ab9d0 con 0x7fdb44073d90 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 -- 172.21.15.16:0/3807217001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb44073d90 msgr2=0x7fdb44140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb44073d90 0x7fdb44140170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c01c490 comp rx=0 tx=0).stop 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 -- 172.21.15.16:0/3807217001 shutdown_connections 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb44073d90 0x7fdb44140170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 --2- 172.21.15.16:0/3807217001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb440b8680 0x7fdb44146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 -- 172.21.15.16:0/3807217001 >> 172.21.15.16:0/3807217001 conn(0x7fdb4406f3d0 msgr2=0x7fdb4406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 -- 172.21.15.16:0/3807217001 shutdown_connections 2024-04-26T22:21:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.388+0000 7fdb49800640 1 -- 172.21.15.16:0/3807217001 wait complete. 2024-04-26T22:21:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 Processor -- start 2024-04-26T22:21:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- start start 2024-04-26T22:21:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb44073d90 0x7fdb4406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb440b8680 0x7fdb440a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4414a800 con 0x7fdb440b66c0 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4414a680 con 0x7fdb440b8680 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb441468c0 con 0x7fdb44073d90 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55932/0 (socket says 172.21.15.16:55932) 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 -- 172.21.15.16:0/3092799886 learned_addr learned my addr 172.21.15.16:0/3092799886 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb42a00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb44073d90 0x7fdb4406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb43400640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb440b8680 0x7fdb440a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 -- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb44073d90 msgr2=0x7fdb4406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb44073d90 0x7fdb4406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 -- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb440b8680 msgr2=0x7fdb440a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb440b8680 0x7fdb440a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 -- 172.21.15.16:0/3092799886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4409bcf0 con 0x7fdb440b66c0 2024-04-26T22:21:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3be00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c01ab40 tx=0x7fdb2c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b9070 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0b4420 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b0040 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb44142ce0 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.392+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4409ba10 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb44069530 con 0x7fdb440b66c0 2024-04-26T22:21:15.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb2c0bc070 con 0x7fdb440b66c0 2024-04-26T22:21:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb3aa00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 0x7fdb2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fdb2c11f740 con 0x7fdb440b66c0 2024-04-26T22:21:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb42a00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 0x7fdb2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.396+0000 7fdb42a00640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 0x7fdb2006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb340079c0 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.400+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb2c016110 con 0x7fdb440b66c0 2024-04-26T22:21:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.564+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb440b16b0 con 0x7fdb440b66c0 2024-04-26T22:21:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb3aa00640 1 -- 172.21.15.16:0/3092799886 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12872 (secure 0 0 0) 0x7fdb2c0efa90 con 0x7fdb440b66c0 2024-04-26T22:21:15.568 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:15.568 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:12.155194+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 msgr2=0x7fdb2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 0x7fdb2006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb340079c0 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 msgr2=0x7fdb44141960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c01ab40 tx=0x7fdb2c019230 comp rx=0 tx=0).stop 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 shutdown_connections 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb20068380 0x7fdb2006a840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb440b8680 0x7fdb440a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb440b66c0 0x7fdb44141960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 --2- 172.21.15.16:0/3092799886 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb44073d90 0x7fdb4406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 >> 172.21.15.16:0/3092799886 conn(0x7fdb4406f3d0 msgr2=0x7fdb440bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 shutdown_connections 2024-04-26T22:21:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.568+0000 7fdb49800640 1 -- 172.21.15.16:0/3092799886 wait complete. 2024-04-26T22:21:15.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:15.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:15.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.732+0000 7f3df6e00640 1 Processor -- start 2024-04-26T22:21:15.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.732+0000 7f3df6e00640 1 -- start start 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df006e410 0x7f3df00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3df01465c0 0x7f3df0149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3df0070a40 con 0x7f3df006e410 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3df006e7f0 con 0x7f3df01465c0 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3df0070760 con 0x7f3df013eec0 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df006e410 0x7f3df00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3df006e410 0x7f3df00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55938/0 (socket says 172.21.15.16:55938) 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 -- 172.21.15.16:0/2849298056 learned_addr learned my addr 172.21.15.16:0/2849298056 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3de7e00640 1 --2- 172.21.15.16:0/2849298056 >> v2:172.21.15.195:3300/0 conn(0x7f3df01465c0 0x7f3df0149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df4e00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 -- 172.21.15.16:0/2849298056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 msgr2=0x7f3df013f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 -- 172.21.15.16:0/2849298056 >> v2:172.21.15.195:3300/0 conn(0x7f3df01465c0 msgr2=0x7f3df0149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 --2- 172.21.15.16:0/2849298056 >> v2:172.21.15.195:3300/0 conn(0x7f3df01465c0 0x7f3df0149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3defe00640 1 -- 172.21.15.16:0/2849298056 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df0148860 con 0x7f3df006e410 2024-04-26T22:21:15.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.736+0000 7f3df4e00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:15.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3defe00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df006e410 0x7f3df00b30d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3df00b7450 tx=0x7f3de001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16d08f1751a9b6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3def400640 1 -- 172.21.15.16:0/2849298056 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de00b0070 con 0x7f3df006e410 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3def400640 1 -- 172.21.15.16:0/2849298056 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de00ab600 con 0x7f3df006e410 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3def400640 1 -- 172.21.15.16:0/2849298056 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de00ab9d0 con 0x7f3df006e410 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- 172.21.15.16:0/2849298056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df006e410 msgr2=0x7f3df00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df006e410 0x7f3df00b30d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3df00b7450 tx=0x7f3de001c490 comp rx=0 tx=0).stop 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- 172.21.15.16:0/2849298056 shutdown_connections 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2849298056 >> v2:172.21.15.195:3300/0 conn(0x7f3df01465c0 0x7f3df0149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2849298056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df006e410 0x7f3df00b30d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- 172.21.15.16:0/2849298056 >> 172.21.15.16:0/2849298056 conn(0x7f3df00b6590 msgr2=0x7f3df00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- 172.21.15.16:0/2849298056 shutdown_connections 2024-04-26T22:21:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- 172.21.15.16:0/2849298056 wait complete. 2024-04-26T22:21:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 Processor -- start 2024-04-26T22:21:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- start start 2024-04-26T22:21:15.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df006e410 0x7f3df01e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3df0145a80 con 0x7f3df01465c0 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3df0145900 con 0x7f3df006e410 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df6e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3df0145c00 con 0x7f3df013eec0 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55948/0 (socket says 172.21.15.16:55948) 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3df4e00640 1 -- 172.21.15.16:0/2886915049 learned_addr learned my addr 172.21.15.16:0/2886915049 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3defe00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df006e410 0x7f3df01e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.740+0000 7f3de7e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 -- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 msgr2=0x7f3df013bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 -- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df006e410 msgr2=0x7f3df01e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df006e410 0x7f3df01e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 -- 172.21.15.16:0/2886915049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df00b6dd0 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3de7e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df4e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3de800cef0 tx=0x7f3de800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de801a070 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de800d860 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de800dc50 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df01e47a0 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df00b8af0 con 0x7f3df01465c0 2024-04-26T22:21:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df0069530 con 0x7f3df01465c0 2024-04-26T22:21:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3de801d070 con 0x7f3df01465c0 2024-04-26T22:21:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 0x7f3dcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3de8086e90 con 0x7f3df01465c0 2024-04-26T22:21:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.744+0000 7f3defe00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 0x7f3dcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.748+0000 7f3defe00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 0x7f3dcc06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3df006ea30 tx=0x7f3de0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.748+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3de8057200 con 0x7f3df01465c0 2024-04-26T22:21:15.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.912+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3df014f060 con 0x7f3df01465c0 2024-04-26T22:21:15.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.912+0000 7f3decc00640 1 -- 172.21.15.16:0/2886915049 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f3de80880a0 con 0x7f3df01465c0 2024-04-26T22:21:15.914 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 msgr2=0x7f3dcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 0x7f3dcc06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3df006ea30 tx=0x7f3de0008040 comp rx=0 tx=0).stop 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 msgr2=0x7f3df00b7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3de800cef0 tx=0x7f3de800a710 comp rx=0 tx=0).stop 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 shutdown_connections 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3dcc068380 0x7f3dcc06a840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3df01465c0 0x7f3df00b7e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3df013eec0 0x7f3df013bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 --2- 172.21.15.16:0/2886915049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3df006e410 0x7f3df01e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:15.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 >> 172.21.15.16:0/2886915049 conn(0x7f3df00b6590 msgr2=0x7f3df014e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:15.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 shutdown_connections 2024-04-26T22:21:15.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:15.916+0000 7f3df6e00640 1 -- 172.21.15.16:0/2886915049 wait complete. 2024-04-26T22:21:15.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:16.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 Processor -- start 2024-04-26T22:21:16.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 -- start start 2024-04-26T22:21:16.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f565c140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565c146a90 con 0x7f565c0b8680 2024-04-26T22:21:16.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f565c0b8dd0 con 0x7f565c0b66c0 2024-04-26T22:21:16.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5663400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f565c0b6b80 con 0x7f565c073d90 2024-04-26T22:21:16.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5660a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f565c0b8680 0x7f565c146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52150/0 (socket says 172.21.15.16:52150) 2024-04-26T22:21:16.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5660a00640 1 -- 172.21.15.16:0/2335536951 learned_addr learned my addr 172.21.15.16:0/2335536951 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407745111 0 0) 0x7f565c146a90 con 0x7f565c0b8680 2024-04-26T22:21:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f565c140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5644003530 con 0x7f565c0b8680 2024-04-26T22:21:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1167132005 0 0) 0x7f5644003530 con 0x7f565c0b8680 2024-04-26T22:21:16.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 msgr2=0x7f565c140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f565c140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 >> v1:172.21.15.195:6789/0 conn(0x7f565c0b66c0 legacy=0x7f565c150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c149ea0 con 0x7f565c0b8680 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f5650001680 con 0x7f565c0b8680 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 >> v1:172.21.15.16:6789/0 conn(0x7f565c0b8680 legacy=0x7f565c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f56440039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644003f70 0x7f5644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f564400bb60 con 0x7f5644003f70 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f564400bce0 con 0x7f5644004d50 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f564400bee0 con 0x7f565c073d90 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644003f70 0x7f5644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5660a00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f56440039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5661400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 -- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 msgr2=0x7f56440039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f56440039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 -- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644004d50 msgr2=0x7f56440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f565be00640 1 -- 172.21.15.16:0/2335536951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5644003530 con 0x7f5644003f70 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5660a00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c073d90 0x7f56440039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:16.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.076+0000 7f5661400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644004d50 0x7f56440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:16.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f565be00640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644003f70 0x7f5644004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5648009ae0 tx=0x7f564801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc5981d03f623b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:16.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480096b0 con 0x7f5644003f70 2024-04-26T22:21:16.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56480a6450 con 0x7f5644003f70 2024-04-26T22:21:16.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f565b400640 1 -- 172.21.15.16:0/2335536951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480a6840 con 0x7f5644003f70 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 -- 172.21.15.16:0/2335536951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644003f70 msgr2=0x7f5644004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 --2- 172.21.15.16:0/2335536951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5644003f70 0x7f5644004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5648009ae0 tx=0x7f564801ca70 comp rx=0 tx=0).stop 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5661400640 1 -- 172.21.15.16:0/2335536951 reap_dead start 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 -- 172.21.15.16:0/2335536951 shutdown_connections 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 -- 172.21.15.16:0/2335536951 >> 172.21.15.16:0/2335536951 conn(0x7f565c06f3d0 msgr2=0x7f565c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 -- 172.21.15.16:0/2335536951 shutdown_connections 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.080+0000 7f5663400640 1 -- 172.21.15.16:0/2335536951 wait complete. 2024-04-26T22:21:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 Processor -- start 2024-04-26T22:21:16.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- start start 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 0x7f565c0baa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 0x7f565c1e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f565c1524c0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f565c152340 con 0x7f5644003f70 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f565c152640 con 0x7f565c0bbb00 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55970/0 (socket says 172.21.15.16:55970) 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 -- 172.21.15.16:0/3967583171 learned_addr learned my addr 172.21.15.16:0/3967583171 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5661400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 0x7f565c1e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5660a00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 0x7f565c0baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 -- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 msgr2=0x7f565c1e29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 0x7f565c1e29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 -- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 msgr2=0x7f565c0baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 0x7f565c0baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 -- 172.21.15.16:0/3967583171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c151ef0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5661400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 0x7f565c1e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5660a00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 0x7f565c0baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f565be00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f564801cf50 tx=0x7f5644005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564800f000 con 0x7f565c0b9fd0 2024-04-26T22:21:16.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56480a6c00 con 0x7f565c0b9fd0 2024-04-26T22:21:16.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56480a7430 con 0x7f565c0b9fd0 2024-04-26T22:21:16.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565c0b5db0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.084+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565c13aac0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565c069530 con 0x7f565c0b9fd0 2024-04-26T22:21:16.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56480a75f0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5658c00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 0x7f563c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:16.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f56481209f0 con 0x7f565c0b9fd0 2024-04-26T22:21:16.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5660a00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 0x7f563c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:16.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.088+0000 7f5660a00640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 0x7f563c06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5650001020 tx=0x7f5650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.092+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f56480ac020 con 0x7f565c0b9fd0 2024-04-26T22:21:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f565c13f360 con 0x7f565c0b9fd0 2024-04-26T22:21:16.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5658c00640 1 -- 172.21.15.16:0/3967583171 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f5648016780 con 0x7f565c0b9fd0 2024-04-26T22:21:16.292 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:16.292 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T22:21:16.292 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 msgr2=0x7f563c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 0x7f563c06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5650001020 tx=0x7f5650009040 comp rx=0 tx=0).stop 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 msgr2=0x7f565c0bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f564801cf50 tx=0x7f5644005840 comp rx=0 tx=0).stop 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 shutdown_connections 2024-04-26T22:21:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f563c068380 0x7f563c06a840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f565c0bbb00 0x7f565c1e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c0b9fd0 0x7f565c0bb5c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 --2- 172.21.15.16:0/3967583171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5644003f70 0x7f565c0baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 >> 172.21.15.16:0/3967583171 conn(0x7f565c06f3d0 msgr2=0x7f565c144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 shutdown_connections 2024-04-26T22:21:16.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:16.292+0000 7f5663400640 1 -- 172.21.15.16:0/3967583171 wait complete. 2024-04-26T22:21:18.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.464+0000 7f0981600640 1 Processor -- start 2024-04-26T22:21:18.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.464+0000 7f0981600640 1 -- start start 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0981600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f097c0b5d30 0x7f097c149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0981600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f097c068780 con 0x7f097c0b6890 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0981600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f097c0b6210 con 0x7f097c0683a0 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0981600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f097c0b64f0 con 0x7f097c0b5d30 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f097c0b6890 0x7f097c148d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52158/0 (socket says 172.21.15.16:52158) 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 -- 172.21.15.16:0/2905312588 learned_addr learned my addr 172.21.15.16:0/2905312588 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097b400640 1 --2- 172.21.15.16:0/2905312588 >> v2:172.21.15.195:3300/0 conn(0x7f097c0b5d30 0x7f097c149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201225904 0 0) 0x7f097c068780 con 0x7f097c0b6890 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0960003530 con 0x7f097c0b6890 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869509841 0 0) 0x7f097c0b6210 con 0x7f097c0683a0 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f097c068780 con 0x7f097c0683a0 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2537276768 0 0) 0x7f0960003530 con 0x7f097c0b6890 2024-04-26T22:21:18.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 >> v2:172.21.15.195:3300/0 conn(0x7f097c0b5d30 msgr2=0x7f097c149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 --2- 172.21.15.16:0/2905312588 >> v2:172.21.15.195:3300/0 conn(0x7f097c0b5d30 0x7f097c149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 >> v1:172.21.15.195:6789/0 conn(0x7f097c0683a0 legacy=0x7f097c073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0a0380 con 0x7f097c0b6890 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f0964001680 con 0x7f097c0b6890 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097b400640 1 --2- 172.21.15.16:0/2905312588 >> v2:172.21.15.195:3300/0 conn(0x7f097c0b5d30 0x7f097c149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 >> v1:172.21.15.16:6789/0 conn(0x7f097c0b6890 legacy=0x7f097c148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960003b50 0x7f0960003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 0x7f0960004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09600051d0 0x7f096000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0b64f0 con 0x7f0960004810 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f096000c100 con 0x7f0960003b50 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f096000c300 con 0x7f09600051d0 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 0x7f0960004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097aa00640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960003b50 0x7f0960003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097b400640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09600051d0 0x7f096000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 -- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09600051d0 msgr2=0x7f096000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09600051d0 0x7f096000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 -- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960003b50 msgr2=0x7f0960003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960003b50 0x7f0960003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f0973e00640 1 -- 172.21.15.16:0/2905312588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0960003530 con 0x7f0960004810 2024-04-26T22:21:18.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.468+0000 7f097b400640 1 -- 172.21.15.16:0/2905312588 reap_dead start 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0973e00640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 0x7f0960004c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c0b6c70 tx=0x7f096401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164436345774e12b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964007cb0 con 0x7f0960004810 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09640a9020 con 0x7f0960004810 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f097a000640 1 -- 172.21.15.16:0/2905312588 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964005b00 con 0x7f0960004810 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 msgr2=0x7f0960004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 0x7f0960004c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c0b6c70 tx=0x7f096401cb80 comp rx=0 tx=0).stop 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- 172.21.15.16:0/2905312588 shutdown_connections 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 --2- 172.21.15.16:0/2905312588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0960004810 0x7f0960004c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- 172.21.15.16:0/2905312588 >> 172.21.15.16:0/2905312588 conn(0x7f097c0bab10 msgr2=0x7f097c0baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- 172.21.15.16:0/2905312588 shutdown_connections 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- 172.21.15.16:0/2905312588 wait complete. 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 Processor -- start 2024-04-26T22:21:18.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.472+0000 7f0981600640 1 -- start start 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 0x7f097c1e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 0x7f097c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f097c06c400 con 0x7f097c143610 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f097c149790 con 0x7f0960004810 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f097c06c580 con 0x7f097c1e52a0 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55988/0 (socket says 172.21.15.16:55988) 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 -- 172.21.15.16:0/237521446 learned_addr learned my addr 172.21.15.16:0/237521446 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f097aa00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 0x7f097c1e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f097b400640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 0x7f097c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 -- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 msgr2=0x7f097c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 0x7f097c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 -- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 msgr2=0x7f097c1e17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 0x7f097c1e17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 -- 172.21.15.16:0/237521446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c1e1e00 con 0x7f097c143610 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f097aa00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 0x7f097c1e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f097b400640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 0x7f097c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0973e00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f096401c9b0 tx=0x7f0960005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09640072d0 con 0x7f097c143610 2024-04-26T22:21:18.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09640b2070 con 0x7f097c143610 2024-04-26T22:21:18.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09640076d0 con 0x7f097c143610 2024-04-26T22:21:18.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c1e20e0 con 0x7f097c143610 2024-04-26T22:21:18.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c1499c0 con 0x7f097c143610 2024-04-26T22:21:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.476+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097c069530 con 0x7f097c143610 2024-04-26T22:21:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.480+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09640a5770 con 0x7f097c143610 2024-04-26T22:21:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.480+0000 7f0972a00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 0x7f095806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.480+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f096411fc70 con 0x7f097c143610 2024-04-26T22:21:18.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.480+0000 7f097aa00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 0x7f095806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.480+0000 7f097aa00640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 0x7f095806a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f096c007fd0 tx=0x7f096c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.484+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0964016890 con 0x7f097c143610 2024-04-26T22:21:18.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.680+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f097c0a0ec0 con 0x7f097c143610 2024-04-26T22:21:18.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.680+0000 7f0972a00640 1 -- 172.21.15.16:0/237521446 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2219 (secure 0 0 0) 0x7f09640f0570 con 0x7f097c143610 2024-04-26T22:21:18.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:18.683 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T22:21:18.683 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 msgr2=0x7f095806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 0x7f095806a840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f096c007fd0 tx=0x7f096c009040 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 msgr2=0x7f097c1e4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f096401c9b0 tx=0x7f0960005840 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 shutdown_connections 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0958068380 0x7f095806a840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f097c1e52a0 0x7f097c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f097c143610 0x7f097c1e4d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 --2- 172.21.15.16:0/237521446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0960004810 0x7f097c1e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 >> 172.21.15.16:0/237521446 conn(0x7f097c0bab10 msgr2=0x7f097c145490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 shutdown_connections 2024-04-26T22:21:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.684+0000 7f0981600640 1 -- 172.21.15.16:0/237521446 wait complete. 2024-04-26T22:21:18.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:18.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 Processor -- start 2024-04-26T22:21:18.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 -- start start 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f74f40757c0 0x7f74f40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74f4145f90 0x7f74f4152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f4075ba0 con 0x7f74f40b5900 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f74f40b01f0 con 0x7f74f4145f90 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74fa600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f74f40b04d0 con 0x7f74f40757c0 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74f4145f90 0x7f74f4152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74f40b5900 0x7f74f4145880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52162/0 (socket says 172.21.15.16:52162) 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74f4145f90 0x7f74f4152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55996/0 (socket says 172.21.15.16:55996) 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f3e00640 1 -- 172.21.15.16:0/740374400 learned_addr learned my addr 172.21.15.16:0/740374400 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9200640 1 --2- 172.21.15.16:0/740374400 >> v2:172.21.15.195:3300/0 conn(0x7f74f40757c0 0x7f74f40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 -- 172.21.15.16:0/740374400 >> v2:172.21.15.195:3300/0 conn(0x7f74f40757c0 msgr2=0x7f74f40b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:18.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 --2- 172.21.15.16:0/740374400 >> v2:172.21.15.195:3300/0 conn(0x7f74f40757c0 0x7f74f40b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 -- 172.21.15.16:0/740374400 >> v1:172.21.15.16:6789/0 conn(0x7f74f40b5900 legacy=0x7f74f4145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f9c00640 1 -- 172.21.15.16:0/740374400 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f40b07b0 con 0x7f74f4145f90 2024-04-26T22:21:18.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.844+0000 7f74f3400640 1 -- 172.21.15.16:0/740374400 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755406341 0 0) 0x7f74f4075ba0 con 0x7f74f40b5900 2024-04-26T22:21:18.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74f9c00640 1 --2- 172.21.15.16:0/740374400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f4145f90 0x7f74f4152fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74f409ca80 tx=0x7f74ec01c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4a985d398e17c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74f3400640 1 -- 172.21.15.16:0/740374400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0b2070 con 0x7f74f4145f90 2024-04-26T22:21:18.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74f3400640 1 -- 172.21.15.16:0/740374400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec0a58f0 con 0x7f74f4145f90 2024-04-26T22:21:18.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74f3400640 1 -- 172.21.15.16:0/740374400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0a5cc0 con 0x7f74f4145f90 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 -- 172.21.15.16:0/740374400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f4145f90 msgr2=0x7f74f4152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 --2- 172.21.15.16:0/740374400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f4145f90 0x7f74f4152fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74f409ca80 tx=0x7f74ec01c7d0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 -- 172.21.15.16:0/740374400 shutdown_connections 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 --2- 172.21.15.16:0/740374400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f4145f90 0x7f74f4152fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 --2- 172.21.15.16:0/740374400 >> v2:172.21.15.195:3300/0 conn(0x7f74f40757c0 0x7f74f40b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 -- 172.21.15.16:0/740374400 >> 172.21.15.16:0/740374400 conn(0x7f74f40ba690 msgr2=0x7f74f40b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 -- 172.21.15.16:0/740374400 shutdown_connections 2024-04-26T22:21:18.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.848+0000 7f74fa600640 1 -- 172.21.15.16:0/740374400 wait complete. 2024-04-26T22:21:18.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 Processor -- start 2024-04-26T22:21:18.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- start start 2024-04-26T22:21:18.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74f40757c0 0x7f74f409fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74f40b3f40 0x7f74f40b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74f40b12b0 con 0x7f74f40b5900 2024-04-26T22:21:18.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f74f40b1130 con 0x7f74f40b3f40 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74f4155d20 con 0x7f74f40757c0 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56010/0 (socket says 172.21.15.16:56010) 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 -- 172.21.15.16:0/3030142307 learned_addr learned my addr 172.21.15.16:0/3030142307 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f9200640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74f40757c0 0x7f74f409fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f9c00640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74f40b3f40 0x7f74f40b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 -- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74f40757c0 msgr2=0x7f74f409fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74f40757c0 0x7f74f409fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 -- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74f40b3f40 msgr2=0x7f74f40b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74f40b3f40 0x7f74f40b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 -- 172.21.15.16:0/3030142307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f40b3550 con 0x7f74f40b5900 2024-04-26T22:21:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f3e00640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74e00011f0 tx=0x7f74e000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0018070 con 0x7f74f40b5900 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e00074e0 con 0x7f74f40b5900 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f40b37d0 con 0x7f74f40b5900 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0004a10 con 0x7f74f40b5900 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f409f080 con 0x7f74f40b5900 2024-04-26T22:21:18.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.852+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f40b1fd0 con 0x7f74f40b5900 2024-04-26T22:21:18.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.856+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f74e001b070 con 0x7f74f40b5900 2024-04-26T22:21:18.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.856+0000 7f74f0c00640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 0x7f74d406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:18.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.856+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f74e00858d0 con 0x7f74f40b5900 2024-04-26T22:21:18.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.856+0000 7f74f9200640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 0x7f74d406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:18.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.856+0000 7f74f9200640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 0x7f74d406a870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007a60 tx=0x7f74e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:18.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:18.860+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f74f40b3550 con 0x7f74f40b5900 2024-04-26T22:21:19.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74f40507b0 con 0x7f74f40b5900 2024-04-26T22:21:19.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74f0c00640 1 -- 172.21.15.16:0/3030142307 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12872 (secure 0 0 0) 0x7f74e0055b80 con 0x7f74f40b5900 2024-04-26T22:21:19.030 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:19.030 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:12.155194+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 msgr2=0x7f74d406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 0x7f74d406a870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007a60 tx=0x7f74e8008040 comp rx=0 tx=0).stop 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 msgr2=0x7f74f40b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74e00011f0 tx=0x7f74e000c9b0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 shutdown_connections 2024-04-26T22:21:19.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f74d40683b0 0x7f74d406a870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f74f40b3f40 0x7f74f40b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74f40b5900 0x7f74f40b3010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 --2- 172.21.15.16:0/3030142307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f74f40757c0 0x7f74f409fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 >> 172.21.15.16:0/3030142307 conn(0x7f74f40ba690 msgr2=0x7f74f40b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 shutdown_connections 2024-04-26T22:21:19.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.028+0000 7f74fa600640 1 -- 172.21.15.16:0/3030142307 wait complete. 2024-04-26T22:21:19.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:19.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:19.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 Processor -- start 2024-04-26T22:21:19.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 -- start start 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e006e410 0x7ff8e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8e013eec0 0x7ff8e013f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e013f870 con 0x7ff8e01465c0 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e0070a40 con 0x7ff8e013eec0 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8e4a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e006e7f0 con 0x7ff8e006e410 2024-04-26T22:21:19.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8de800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8e013eec0 0x7ff8e013f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8dd400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8e01465c0 0x7ff8e0149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52166/0 (socket says 172.21.15.16:52166) 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8dd400640 1 -- 172.21.15.16:0/2404732248 learned_addr learned my addr 172.21.15.16:0/2404732248 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8dde00640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e006e410 0x7ff8e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8de800640 1 -- 172.21.15.16:0/2404732248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e006e410 msgr2=0x7ff8e00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8de800640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e006e410 0x7ff8e00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8de800640 1 -- 172.21.15.16:0/2404732248 >> v1:172.21.15.16:6789/0 conn(0x7ff8e01465c0 legacy=0x7ff8e0149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8de800640 1 -- 172.21.15.16:0/2404732248 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e0070760 con 0x7ff8e013eec0 2024-04-26T22:21:19.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.196+0000 7ff8dca00640 1 -- 172.21.15.16:0/2404732248 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486833115 0 0) 0x7ff8e013f870 con 0x7ff8e01465c0 2024-04-26T22:21:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8de800640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e013eec0 0x7ff8e013f330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009d90 tx=0x7ff8d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15b659f496f65d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8dca00640 1 -- 172.21.15.16:0/2404732248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80b2070 con 0x7ff8e013eec0 2024-04-26T22:21:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8dca00640 1 -- 172.21.15.16:0/2404732248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d80a5890 con 0x7ff8e013eec0 2024-04-26T22:21:19.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8dca00640 1 -- 172.21.15.16:0/2404732248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80a5c60 con 0x7ff8e013eec0 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- 172.21.15.16:0/2404732248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e013eec0 msgr2=0x7ff8e013f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e013eec0 0x7ff8e013f330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009d90 tx=0x7ff8d801c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- 172.21.15.16:0/2404732248 shutdown_connections 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e013eec0 0x7ff8e013f330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/2404732248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e006e410 0x7ff8e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- 172.21.15.16:0/2404732248 >> 172.21.15.16:0/2404732248 conn(0x7ff8e00b6590 msgr2=0x7ff8e00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- 172.21.15.16:0/2404732248 shutdown_connections 2024-04-26T22:21:19.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- 172.21.15.16:0/2404732248 wait complete. 2024-04-26T22:21:19.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 Processor -- start 2024-04-26T22:21:19.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.200+0000 7ff8e4a00640 1 -- start start 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 0x7ff8e01307f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e01465c0 0x7ff8e0136a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0152600 con 0x7ff8e006e410 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e0152480 con 0x7ff8e013eec0 2024-04-26T22:21:19.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e0152780 con 0x7ff8e01465c0 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56018/0 (socket says 172.21.15.16:56018) 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 -- 172.21.15.16:0/1045337768 learned_addr learned my addr 172.21.15.16:0/1045337768 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dd400640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 0x7ff8e01307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8de800640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e01465c0 0x7ff8e0136a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 -- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e01465c0 msgr2=0x7ff8e0136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e01465c0 0x7ff8e0136a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 -- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 msgr2=0x7ff8e01307f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 0x7ff8e01307f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 -- 172.21.15.16:0/1045337768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e0132e50 con 0x7ff8e006e410 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dd400640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 0x7ff8e01307f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8dde00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000e960 tx=0x7ff8d000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0017070 con 0x7ff8e006e410 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d000ca00 con 0x7ff8e006e410 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000cdb0 con 0x7ff8e006e410 2024-04-26T22:21:19.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e01e4740 con 0x7ff8e006e410 2024-04-26T22:21:19.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e01e3c60 con 0x7ff8e006e410 2024-04-26T22:21:19.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e0069530 con 0x7ff8e006e410 2024-04-26T22:21:19.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.204+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8d001a070 con 0x7ff8e006e410 2024-04-26T22:21:19.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.208+0000 7ff8d6000640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 0x7ff8c006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.208+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff8d0086610 con 0x7ff8e006e410 2024-04-26T22:21:19.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.208+0000 7ff8dd400640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 0x7ff8c006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.208+0000 7ff8dd400640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 0x7ff8c006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8e014f690 tx=0x7ff8cc007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.212+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff8d0056f10 con 0x7ff8e006e410 2024-04-26T22:21:19.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.376+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8e01330c0 con 0x7ff8e006e410 2024-04-26T22:21:19.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.376+0000 7ff8d6000640 1 -- 172.21.15.16:0/1045337768 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7ff8d0056810 con 0x7ff8e006e410 2024-04-26T22:21:19.378 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:19.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 msgr2=0x7ff8c006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 0x7ff8c006a870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8e014f690 tx=0x7ff8cc007cb0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 msgr2=0x7ff8e0146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000e960 tx=0x7ff8d000ee20 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 shutdown_connections 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff8c00683b0 0x7ff8c006a870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff8e01465c0 0x7ff8e0136a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8e013eec0 0x7ff8e01307f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 --2- 172.21.15.16:0/1045337768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8e006e410 0x7ff8e0146ee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 >> 172.21.15.16:0/1045337768 conn(0x7ff8e00b6590 msgr2=0x7ff8e014dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 shutdown_connections 2024-04-26T22:21:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.380+0000 7ff8e4a00640 1 -- 172.21.15.16:0/1045337768 wait complete. 2024-04-26T22:21:19.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:21:19.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.536+0000 7f4e99a00640 1 Processor -- start 2024-04-26T22:21:19.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.536+0000 7f4e99a00640 1 -- start start 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.536+0000 7f4e99a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e9406e450 0x7f4e940b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e99a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9406e830 con 0x7f4e9414dac0 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e99a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e940b0a30 con 0x7f4e9413ef30 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e99a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4e940b0d10 con 0x7f4e9406e450 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e93400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4e9414dac0 0x7f4e9414feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52182/0 (socket says 172.21.15.16:52182) 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e93400640 1 -- 172.21.15.16:0/3646743617 learned_addr learned my addr 172.21.15.16:0/3646743617 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:19.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92a00640 1 --2- 172.21.15.16:0/3646743617 >> v2:172.21.15.195:3300/0 conn(0x7f4e9406e450 0x7f4e940b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002347864 0 0) 0x7f4e9406e830 con 0x7f4e9414dac0 2024-04-26T22:21:19.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78005740 con 0x7f4e9414dac0 2024-04-26T22:21:19.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267095800 0 0) 0x7f4e940b0a30 con 0x7f4e9413ef30 2024-04-26T22:21:19.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e9406e830 con 0x7f4e9413ef30 2024-04-26T22:21:19.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92a00640 1 -- 172.21.15.16:0/3646743617 >> v1:172.21.15.195:6789/0 conn(0x7f4e9413ef30 legacy=0x7f4e9413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489609604 0 0) 0x7f4e78005740 con 0x7f4e9414dac0 2024-04-26T22:21:19.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92a00640 1 -- 172.21.15.16:0/3646743617 >> v1:172.21.15.16:6789/0 conn(0x7f4e9414dac0 legacy=0x7f4e9414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.540+0000 7f4e92a00640 1 -- 172.21.15.16:0/3646743617 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e940b2cf0 con 0x7f4e9406e450 2024-04-26T22:21:19.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e92a00640 1 --2- 172.21.15.16:0/3646743617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9406e450 0x7f4e940b1020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e840097c0 tx=0x7f4e8401c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274427bfba0b276e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e840b0070 con 0x7f4e9406e450 2024-04-26T22:21:19.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e840ab400 con 0x7f4e9406e450 2024-04-26T22:21:19.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e92000640 1 -- 172.21.15.16:0/3646743617 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c001a00 con 0x7f4e9406e450 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- 172.21.15.16:0/3646743617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9406e450 msgr2=0x7f4e940b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 --2- 172.21.15.16:0/3646743617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9406e450 0x7f4e940b1020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e840097c0 tx=0x7f4e8401c2a0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- 172.21.15.16:0/3646743617 shutdown_connections 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 --2- 172.21.15.16:0/3646743617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9406e450 0x7f4e940b1020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- 172.21.15.16:0/3646743617 >> 172.21.15.16:0/3646743617 conn(0x7f4e940b6620 msgr2=0x7f4e940b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- 172.21.15.16:0/3646743617 shutdown_connections 2024-04-26T22:21:19.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- 172.21.15.16:0/3646743617 wait complete. 2024-04-26T22:21:19.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 Processor -- start 2024-04-26T22:21:19.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- start start 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e9406e450 0x7f4e94140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 0x7f4e94071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e940b29b0 con 0x7f4e9414dac0 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e940b2830 con 0x7f4e9413ef30 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e99a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e940b34f0 con 0x7f4e9406e450 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e93400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e93400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56034/0 (socket says 172.21.15.16:56034) 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e93400640 1 -- 172.21.15.16:0/755669482 learned_addr learned my addr 172.21.15.16:0/755669482 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e92a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e9406e450 0x7f4e94140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.544+0000 7f4e8a000640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 0x7f4e94071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 -- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e9406e450 msgr2=0x7f4e94140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e9406e450 0x7f4e94140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 -- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 msgr2=0x7f4e94071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 0x7f4e94071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 -- 172.21.15.16:0/755669482 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e94142300 con 0x7f4e9414dac0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e8a000640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 0x7f4e94071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e93400640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00cc30 tx=0x7f4e8c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c017070 con 0x7f4e9414dac0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c00ce40 con 0x7f4e9414dac0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e94071270 con 0x7f4e9414dac0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c012620 con 0x7f4e9414dac0 2024-04-26T22:21:19.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e94142a70 con 0x7f4e9414dac0 2024-04-26T22:21:19.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e94069530 con 0x7f4e9414dac0 2024-04-26T22:21:19.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.548+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e8c01a070 con 0x7f4e9414dac0 2024-04-26T22:21:19.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.552+0000 7f4e8b400640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 0x7f4e7006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.552+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4e8c086440 con 0x7f4e9414dac0 2024-04-26T22:21:19.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.552+0000 7f4e92a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 0x7f4e7006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.552+0000 7f4e92a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 0x7f4e7006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ad000 tx=0x7f4e840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.556+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e8c0566f0 con 0x7f4e9414dac0 2024-04-26T22:21:19.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.720+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4e940b8540 con 0x7f4e9414dac0 2024-04-26T22:21:19.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.720+0000 7f4e8b400640 1 -- 172.21.15.16:0/755669482 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f4e8c05a9f0 con 0x7f4e9414dac0 2024-04-26T22:21:19.722 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:19.722 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-26T22:21:19.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:21:19.723 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-26T22:21:19.723 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-26T22:21:19.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:21:19.723 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 msgr2=0x7f4e7006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 0x7f4e7006a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e840ad000 tx=0x7f4e840a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 msgr2=0x7f4e94072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00cc30 tx=0x7f4e8c00a430 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 shutdown_connections 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e700683b0 0x7f4e7006a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9414dac0 0x7f4e94072290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e9413ef30 0x7f4e94071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 --2- 172.21.15.16:0/755669482 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e9406e450 0x7f4e94140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 >> 172.21.15.16:0/755669482 conn(0x7f4e940b6620 msgr2=0x7f4e940b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 shutdown_connections 2024-04-26T22:21:19.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.724+0000 7f4e99a00640 1 -- 172.21.15.16:0/755669482 wait complete. 2024-04-26T22:21:19.743 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:21:19.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:21:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 Processor -- start 2024-04-26T22:21:19.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 -- start start 2024-04-26T22:21:19.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7f2c06e130 0x7f7f2c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 0x7f7f2c148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 0x7f7f2c148940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c0affa0 con 0x7f7f2c06e130 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c0b02e0 con 0x7f7f2c0b3d70 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f33e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c06e510 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7f2c06e130 0x7f7f2c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7f2c06e130 0x7f7f2c0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56044/0 (socket says 172.21.15.16:56044) 2024-04-26T22:21:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 -- 172.21.15.16:0/3431191951 learned_addr learned my addr 172.21.15.16:0/3431191951 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f30a00640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 0x7f7f2c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31e00640 1 --2- 172.21.15.16:0/3431191951 >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 0x7f7f2c148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 -- 172.21.15.16:0/3431191951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 msgr2=0x7f7f2c148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 0x7f7f2c148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 -- 172.21.15.16:0/3431191951 >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 msgr2=0x7f7f2c148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 --2- 172.21.15.16:0/3431191951 >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 0x7f7f2c148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31400640 1 -- 172.21.15.16:0/3431191951 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c0af7a0 con 0x7f7f2c06e130 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f31e00640 1 --2- 172.21.15.16:0/3431191951 >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 0x7f7f2c148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.888+0000 7f7f30a00640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 0x7f7f2c148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f31400640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c06e130 0x7f7f2c0b3830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0aef10 tx=0x7f7f2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c97a3047c7eeb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f2be00640 1 -- 172.21.15.16:0/3431191951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200b0070 con 0x7f7f2c06e130 2024-04-26T22:21:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f2be00640 1 -- 172.21.15.16:0/3431191951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f200ab600 con 0x7f7f2c06e130 2024-04-26T22:21:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f2be00640 1 -- 172.21.15.16:0/3431191951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200ab9d0 con 0x7f7f2c06e130 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- 172.21.15.16:0/3431191951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c06e130 msgr2=0x7f7f2c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c06e130 0x7f7f2c0b3830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0aef10 tx=0x7f7f2001c400 comp rx=0 tx=0).stop 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- 172.21.15.16:0/3431191951 shutdown_connections 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 --2- 172.21.15.16:0/3431191951 >> v2:172.21.15.195:3300/0 conn(0x7f7f2c0b3d70 0x7f7f2c148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c0b61f0 0x7f7f2c148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 --2- 172.21.15.16:0/3431191951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c06e130 0x7f7f2c0b3830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- 172.21.15.16:0/3431191951 >> 172.21.15.16:0/3431191951 conn(0x7f7f2c0b6620 msgr2=0x7f7f2c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- 172.21.15.16:0/3431191951 shutdown_connections 2024-04-26T22:21:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- 172.21.15.16:0/3431191951 wait complete. 2024-04-26T22:21:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 Processor -- start 2024-04-26T22:21:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.892+0000 7f7f33e00640 1 -- start start 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c06e130 0x7f7f2c13b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f2c0b3d70 0x7f7f2c1e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0aea10 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0ae890 con 0x7f7f2c0b3d70 2024-04-26T22:21:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c14c200 con 0x7f7f2c06e130 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56054/0 (socket says 172.21.15.16:56054) 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 -- 172.21.15.16:0/2918693148 learned_addr learned my addr 172.21.15.16:0/2918693148 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f30a00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f2c0b3d70 0x7f7f2c1e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31400640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c06e130 0x7f7f2c13b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 -- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c06e130 msgr2=0x7f7f2c13b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c06e130 0x7f7f2c13b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 -- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f2c0b3d70 msgr2=0x7f7f2c1e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f2c0b3d70 0x7f7f2c1e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 -- 172.21.15.16:0/2918693148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c13eeb0 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f31e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400cf20 tx=0x7f7f2400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2401a070 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2400d840 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2400dc30 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c13e370 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c146050 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c069530 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.896+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f2401d070 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.900+0000 7f7f29600640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 0x7f7f0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.900+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f7f24086ec0 con 0x7f7f2c0b61f0 2024-04-26T22:21:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.900+0000 7f7f31400640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 0x7f7f0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.900+0000 7f7f31400640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 0x7f7f0c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f200ad000 tx=0x7f7f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:19.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:19.904+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7f24057890 con 0x7f7f2c0b61f0 2024-04-26T22:21:20.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.068+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7f2c13c430 con 0x7f7f2c0b61f0 2024-04-26T22:21:20.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f29600640 1 -- 172.21.15.16:0/2918693148 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f7f24057190 con 0x7f7f2c0b61f0 2024-04-26T22:21:20.367 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 msgr2=0x7f7f0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 0x7f7f0c06a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f200ad000 tx=0x7f7f20008040 comp rx=0 tx=0).stop 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 msgr2=0x7f7f2c1e12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400cf20 tx=0x7f7f2400a7d0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 shutdown_connections 2024-04-26T22:21:20.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7f0c068380 0x7f7f0c06a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0b61f0 0x7f7f2c1e12c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f2c0b3d70 0x7f7f2c1e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 --2- 172.21.15.16:0/2918693148 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f2c06e130 0x7f7f2c13b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 >> 172.21.15.16:0/2918693148 conn(0x7f7f2c0b6620 msgr2=0x7f7f2c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 shutdown_connections 2024-04-26T22:21:20.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.368+0000 7f7f33e00640 1 -- 172.21.15.16:0/2918693148 wait complete. 2024-04-26T22:21:20.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:21:20.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 Processor -- start 2024-04-26T22:21:20.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 -- start start 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e600b7880 0x7f4e60070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e60070550 0x7f4e60152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e600a12d0 con 0x7f4e60073860 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4e600b7210 con 0x7f4e60070550 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e66e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e600b76a0 con 0x7f4e600b7880 2024-04-26T22:21:20.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e60070550 0x7f4e60152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4e60070550 0x7f4e60152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56068/0 (socket says 172.21.15.16:56068) 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 -- 172.21.15.16:0/1664533247 learned_addr learned my addr 172.21.15.16:0/1664533247 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e5fe00640 1 --1- 172.21.15.16:0/1664533247 >> v1:172.21.15.16:6789/0 conn(0x7f4e60073860 0x7f4e60142440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52198/0 (socket says 172.21.15.16:52198) 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e57e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e600b7880 0x7f4e60070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 -- 172.21.15.16:0/1664533247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e600b7880 msgr2=0x7f4e60070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e600b7880 0x7f4e60070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 -- 172.21.15.16:0/1664533247 >> v1:172.21.15.16:6789/0 conn(0x7f4e60073860 legacy=0x7f4e60142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e64e00640 1 -- 172.21.15.16:0/1664533247 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e600b6ed0 con 0x7f4e60070550 2024-04-26T22:21:20.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.544+0000 7f4e5f400640 1 -- 172.21.15.16:0/1664533247 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725550051 0 0) 0x7f4e600a12d0 con 0x7f4e60073860 2024-04-26T22:21:20.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e64e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60152df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009e50 tx=0x7f4e5801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da96daad61856f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:20.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e5f400640 1 -- 172.21.15.16:0/1664533247 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a5860 con 0x7f4e60070550 2024-04-26T22:21:20.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e5f400640 1 -- 172.21.15.16:0/1664533247 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e580a5a00 con 0x7f4e60070550 2024-04-26T22:21:20.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e5f400640 1 -- 172.21.15.16:0/1664533247 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e580a5dd0 con 0x7f4e60070550 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 -- 172.21.15.16:0/1664533247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 msgr2=0x7f4e60152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60152df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009e50 tx=0x7f4e5801c9a0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 -- 172.21.15.16:0/1664533247 shutdown_connections 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60152df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 --2- 172.21.15.16:0/1664533247 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e600b7880 0x7f4e60070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 -- 172.21.15.16:0/1664533247 >> 172.21.15.16:0/1664533247 conn(0x7f4e600b8850 msgr2=0x7f4e600b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:20.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 -- 172.21.15.16:0/1664533247 shutdown_connections 2024-04-26T22:21:20.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.548+0000 7f4e66e00640 1 -- 172.21.15.16:0/1664533247 wait complete. 2024-04-26T22:21:20.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 Processor -- start 2024-04-26T22:21:20.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- start start 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e60073860 0x7f4e60145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e60145b70 0x7f4e6013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e60071280 con 0x7f4e60070550 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e60071100 con 0x7f4e60145b70 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e60142b50 con 0x7f4e60073860 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56080/0 (socket says 172.21.15.16:56080) 2024-04-26T22:21:20.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 -- 172.21.15.16:0/149679606 learned_addr learned my addr 172.21.15.16:0/149679606 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e64e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e60145b70 0x7f4e6013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e57e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e60073860 0x7f4e60145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 -- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e60073860 msgr2=0x7f4e60145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e60073860 0x7f4e60145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 -- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e60145b70 msgr2=0x7f4e6013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e60145b70 0x7f4e6013d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:20.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 -- 172.21.15.16:0/149679606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60146f00 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5fe00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c4b0 tx=0x7f4e5000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50018070 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e50007500 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50004a30 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e601471e0 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e60146380 con 0x7f4e60070550 2024-04-26T22:21:20.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.552+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e60147700 con 0x7f4e60070550 2024-04-26T22:21:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.556+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e5001b070 con 0x7f4e60070550 2024-04-26T22:21:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.556+0000 7f4e5cc00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 0x7f4e3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:20.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.556+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f4e50085ab0 con 0x7f4e60070550 2024-04-26T22:21:20.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.556+0000 7f4e57e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 0x7f4e3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:20.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.556+0000 7f4e57e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 0x7f4e3c06a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e600b9410 tx=0x7f4e48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:20.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.560+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e50055b60 con 0x7f4e60070550 2024-04-26T22:21:20.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:20.728+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4e60069530 con 0x7f4e60070550 2024-04-26T22:21:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.368+0000 7f4e5cc00640 1 -- 172.21.15.16:0/149679606 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f4e50059e60 con 0x7f4e60070550 2024-04-26T22:21:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-26T22:21:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 msgr2=0x7f4e3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 0x7f4e3c06a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e600b9410 tx=0x7f4e48008040 comp rx=0 tx=0).stop 2024-04-26T22:21:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 msgr2=0x7f4e60147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c4b0 tx=0x7f4e5000c970 comp rx=0 tx=0).stop 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 shutdown_connections 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e3c068380 0x7f4e3c06a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e60145b70 0x7f4e6013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e60073860 0x7f4e60145630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 --2- 172.21.15.16:0/149679606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e60070550 0x7f4e60147ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 >> 172.21.15.16:0/149679606 conn(0x7f4e600b8850 msgr2=0x7f4e6006da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 shutdown_connections 2024-04-26T22:21:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.372+0000 7f4e66e00640 1 -- 172.21.15.16:0/149679606 wait complete. 2024-04-26T22:21:21.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:21:21.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 Processor -- start 2024-04-26T22:21:21.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 -- start start 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ec41465c0 0x7f8ec40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ec413eec0 0x7f8ec413f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec413f850 con 0x7f8ec406e410 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec4070a40 con 0x7f8ec413eec0 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8eca200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec406e7f0 con 0x7f8ec41465c0 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ec413eec0 0x7f8ec413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ec413eec0 0x7f8ec413f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56082/0 (socket says 172.21.15.16:56082) 2024-04-26T22:21:21.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 -- 172.21.15.16:0/829355942 learned_addr learned my addr 172.21.15.16:0/829355942 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:21.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ebbe00640 1 --2- 172.21.15.16:0/829355942 >> v2:172.21.15.195:3300/0 conn(0x7f8ec41465c0 0x7f8ec40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 -- 172.21.15.16:0/829355942 >> v2:172.21.15.195:3300/0 conn(0x7f8ec41465c0 msgr2=0x7f8ec40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:21.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 --2- 172.21.15.16:0/829355942 >> v2:172.21.15.195:3300/0 conn(0x7f8ec41465c0 0x7f8ec40b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 -- 172.21.15.16:0/829355942 >> v1:172.21.15.195:6789/0 conn(0x7f8ec406e410 legacy=0x7f8ec4149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:21.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.564+0000 7f8ec3e00640 1 -- 172.21.15.16:0/829355942 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec4070760 con 0x7f8ec413eec0 2024-04-26T22:21:21.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8ec3e00640 1 --2- 172.21.15.16:0/829355942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec413f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40b7450 tx=0x7f8ebc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e669023a58146c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:21.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8ec2a00640 1 -- 172.21.15.16:0/829355942 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0a56d0 con 0x7f8ec413eec0 2024-04-26T22:21:21.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8ec2a00640 1 -- 172.21.15.16:0/829355942 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc0a5870 con 0x7f8ec413eec0 2024-04-26T22:21:21.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8ec2a00640 1 -- 172.21.15.16:0/829355942 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0a5c40 con 0x7f8ec413eec0 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 -- 172.21.15.16:0/829355942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 msgr2=0x7f8ec413f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 --2- 172.21.15.16:0/829355942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec413f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40b7450 tx=0x7f8ebc01c920 comp rx=0 tx=0).stop 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 -- 172.21.15.16:0/829355942 shutdown_connections 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 --2- 172.21.15.16:0/829355942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec413f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 --2- 172.21.15.16:0/829355942 >> v2:172.21.15.195:3300/0 conn(0x7f8ec41465c0 0x7f8ec40b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 -- 172.21.15.16:0/829355942 >> 172.21.15.16:0/829355942 conn(0x7f8ec40b6590 msgr2=0x7f8ec40b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 -- 172.21.15.16:0/829355942 shutdown_connections 2024-04-26T22:21:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.568+0000 7f8eca200640 1 -- 172.21.15.16:0/829355942 wait complete. 2024-04-26T22:21:21.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 Processor -- start 2024-04-26T22:21:21.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- start start 2024-04-26T22:21:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 0x7f8ec4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 0x7f8ec41e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41505f0 con 0x7f8ec413eec0 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4150470 con 0x7f8ec41465c0 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec4150770 con 0x7f8ec406e410 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56084/0 (socket says 172.21.15.16:56084) 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 -- 172.21.15.16:0/2701673268 learned_addr learned my addr 172.21.15.16:0/2701673268 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ec3400640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 0x7f8ec4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ec3e00640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 0x7f8ec41e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 -- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 msgr2=0x7f8ec4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 0x7f8ec4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 -- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 msgr2=0x7f8ec41e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 0x7f8ec41e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 -- 172.21.15.16:0/2701673268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec41e42f0 con 0x7f8ec413eec0 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ec3e00640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 0x7f8ec41e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ec3400640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 0x7f8ec4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebbe00640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00d830 tx=0x7f8eac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00b6c0 con 0x7f8ec413eec0 2024-04-26T22:21:21.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac019070 con 0x7f8ec413eec0 2024-04-26T22:21:21.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec41e45b0 con 0x7f8ec413eec0 2024-04-26T22:21:21.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00ba60 con 0x7f8ec413eec0 2024-04-26T22:21:21.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.572+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec4143400 con 0x7f8ec413eec0 2024-04-26T22:21:21.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec4069530 con 0x7f8ec413eec0 2024-04-26T22:21:21.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8eac01e460 con 0x7f8ec413eec0 2024-04-26T22:21:21.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8ebb400640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 0x7f8ea006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:21.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f8eac087b80 con 0x7f8ec413eec0 2024-04-26T22:21:21.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8ec3400640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 0x7f8ea006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:21.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.576+0000 7f8ec3400640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 0x7f8ea006a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40098b0 tx=0x7f8eb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:21.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.580+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8eac058180 con 0x7f8ec413eec0 2024-04-26T22:21:21.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:21.780+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8ec40b8f10 con 0x7f8ec413eec0 2024-04-26T22:21:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.396+0000 7f8ebb400640 1 -- 172.21.15.16:0/2701673268 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8eac057a80 con 0x7f8ec413eec0 2024-04-26T22:21:22.400 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T22:21:22.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.404+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 msgr2=0x7f8ea006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.404+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 0x7f8ea006a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40098b0 tx=0x7f8eb4008040 comp rx=0 tx=0).stop 2024-04-26T22:21:22.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.404+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 msgr2=0x7f8ec4141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.404+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00d830 tx=0x7f8eac00dcf0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 shutdown_connections 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ea0068380 0x7f8ea006a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ec41465c0 0x7f8ec41e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ec413eec0 0x7f8ec4141e90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 --2- 172.21.15.16:0/2701673268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ec406e410 0x7f8ec4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.408+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 >> 172.21.15.16:0/2701673268 conn(0x7f8ec40b6590 msgr2=0x7f8ec40b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:22.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.416+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 shutdown_connections 2024-04-26T22:21:22.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.416+0000 7f8eca200640 1 -- 172.21.15.16:0/2701673268 wait complete. 2024-04-26T22:21:22.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:22.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 Processor -- start 2024-04-26T22:21:22.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 -- start start 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b7000 0x7ffacc0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffacc142490 0x7ffacc142900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffacc0b73e0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffacc0b6c00 con 0x7ffacc0b7000 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad3600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ffacc0b7750 con 0x7ffacc142490 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b7000 0x7ffacc0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b7000 0x7ffacc0b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56094/0 (socket says 172.21.15.16:56094) 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 -- 172.21.15.16:0/236479601 learned_addr learned my addr 172.21.15.16:0/236479601 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad1600640 1 --2- 172.21.15.16:0/236479601 >> v2:172.21.15.195:3300/0 conn(0x7ffacc142490 0x7ffacc142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 -- 172.21.15.16:0/236479601 >> v2:172.21.15.195:3300/0 conn(0x7ffacc142490 msgr2=0x7ffacc142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 --2- 172.21.15.16:0/236479601 >> v2:172.21.15.195:3300/0 conn(0x7ffacc142490 0x7ffacc142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 -- 172.21.15.16:0/236479601 >> v1:172.21.15.195:6789/0 conn(0x7ffacc06d1d0 legacy=0x7ffacc0b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:22.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.588+0000 7ffad0c00640 1 -- 172.21.15.16:0/236479601 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc0b7ab0 con 0x7ffacc0b7000 2024-04-26T22:21:22.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad0c00640 1 --2- 172.21.15.16:0/236479601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b7000 0x7ffacc0b66c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b6380 tx=0x7ffabc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252b823e823a4afe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:22.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffacbe00640 1 -- 172.21.15.16:0/236479601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b0070 con 0x7ffacc0b7000 2024-04-26T22:21:22.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffacbe00640 1 -- 172.21.15.16:0/236479601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc0ab600 con 0x7ffacc0b7000 2024-04-26T22:21:22.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffacbe00640 1 -- 172.21.15.16:0/236479601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab9d0 con 0x7ffacc0b7000 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 -- 172.21.15.16:0/236479601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b7000 msgr2=0x7ffacc0b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 --2- 172.21.15.16:0/236479601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b7000 0x7ffacc0b66c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b6380 tx=0x7ffabc01c4c0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 -- 172.21.15.16:0/236479601 shutdown_connections 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 --2- 172.21.15.16:0/236479601 >> v2:172.21.15.195:3300/0 conn(0x7ffacc142490 0x7ffacc142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 --2- 172.21.15.16:0/236479601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b7000 0x7ffacc0b66c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 -- 172.21.15.16:0/236479601 >> 172.21.15.16:0/236479601 conn(0x7ffacc06f3d0 msgr2=0x7ffacc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 -- 172.21.15.16:0/236479601 shutdown_connections 2024-04-26T22:21:22.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.592+0000 7ffad3600640 1 -- 172.21.15.16:0/236479601 wait complete. 2024-04-26T22:21:22.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 Processor -- start 2024-04-26T22:21:22.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- start start 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 0x7ffacc1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc142490 0x7ffacc146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1559d0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc155850 con 0x7ffacc0b7000 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc155b50 con 0x7ffacc142490 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56104/0 (socket says 172.21.15.16:56104) 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 -- 172.21.15.16:0/608357885 learned_addr learned my addr 172.21.15.16:0/608357885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 -- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc142490 msgr2=0x7ffacc146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc142490 0x7ffacc146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 -- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 msgr2=0x7ffacc1467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffac3e00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 0x7ffacc1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 0x7ffacc1467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 -- 172.21.15.16:0/608357885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1431c0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffac3e00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 0x7ffacc1467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:22.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad0c00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ae040 tx=0x7ffabc01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ba020 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc0b6420 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b0040 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc142ef0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc148130 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.596+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc069530 con 0x7ffacc06d1d0 2024-04-26T22:21:22.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.600+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffabc0bd020 con 0x7ffacc06d1d0 2024-04-26T22:21:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.600+0000 7ffac9600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.600+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffabc1208b0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.600+0000 7ffac3e00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.600+0000 7ffac3e00640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffacc13f6c0 tx=0x7ffab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:22.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.604+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffabc0c4070 con 0x7ffacc06d1d0 2024-04-26T22:21:22.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.768+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffacc144500 con 0x7ffacc06d1d0 2024-04-26T22:21:22.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.768+0000 7ffac9600640 1 -- 172.21.15.16:0/608357885 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16606 (secure 0 0 0) 0x7ffabc0160b0 con 0x7ffacc06d1d0 2024-04-26T22:21:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:22.771 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:21.782618+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 msgr2=0x7ffaa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffacc13f6c0 tx=0x7ffab4009040 comp rx=0 tx=0).stop 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 msgr2=0x7ffacc0a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0ae040 tx=0x7ffabc01ad00 comp rx=0 tx=0).stop 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 shutdown_connections 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc142490 0x7ffacc146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b7000 0x7ffacc1467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 --2- 172.21.15.16:0/608357885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc06d1d0 0x7ffacc0a14f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 >> 172.21.15.16:0/608357885 conn(0x7ffacc06f3d0 msgr2=0x7ffacc13eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 shutdown_connections 2024-04-26T22:21:22.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.772+0000 7ffad3600640 1 -- 172.21.15.16:0/608357885 wait complete. 2024-04-26T22:21:22.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:22.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 Processor -- start 2024-04-26T22:21:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 -- start start 2024-04-26T22:21:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0c48073d90 0x7f0c48140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c48146a90 con 0x7f0c480b66c0 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c480b8dd0 con 0x7f0c480b8680 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c4e200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0c480b6b80 con 0x7f0c48073d90 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c47e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0c480b66c0 0x7f0c48150c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52200/0 (socket says 172.21.15.16:52200) 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c47e00640 1 -- 172.21.15.16:0/4144005644 learned_addr learned my addr 172.21.15.16:0/4144005644 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46a00640 1 --2- 172.21.15.16:0/4144005644 >> v2:172.21.15.195:3300/0 conn(0x7f0c48073d90 0x7f0c48140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2261550391 0 0) 0x7f0c48146a90 con 0x7f0c480b66c0 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c2c003530 con 0x7f0c480b66c0 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3289298889 0 0) 0x7f0c2c003530 con 0x7f0c480b66c0 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46a00640 1 -- 172.21.15.16:0/4144005644 >> v1:172.21.15.195:6789/0 conn(0x7f0c480b8680 legacy=0x7f0c48146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46a00640 1 -- 172.21.15.16:0/4144005644 >> v1:172.21.15.16:6789/0 conn(0x7f0c480b66c0 legacy=0x7f0c48150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.932+0000 7f0c46a00640 1 -- 172.21.15.16:0/4144005644 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c48149ea0 con 0x7f0c48073d90 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c46a00640 1 --2- 172.21.15.16:0/4144005644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48073d90 0x7f0c48140170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097c0 tx=0x7f0c3401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9404e8214ee146 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b0070 con 0x7f0c48073d90 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c340ab400 con 0x7f0c48073d90 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c46000640 1 -- 172.21.15.16:0/4144005644 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40001a00 con 0x7f0c48073d90 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 -- 172.21.15.16:0/4144005644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48073d90 msgr2=0x7f0c48140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 --2- 172.21.15.16:0/4144005644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48073d90 0x7f0c48140170 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c340097c0 tx=0x7f0c3401c330 comp rx=0 tx=0).stop 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 -- 172.21.15.16:0/4144005644 shutdown_connections 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 --2- 172.21.15.16:0/4144005644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c48073d90 0x7f0c48140170 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 -- 172.21.15.16:0/4144005644 >> 172.21.15.16:0/4144005644 conn(0x7f0c4806f3d0 msgr2=0x7f0c4806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 -- 172.21.15.16:0/4144005644 shutdown_connections 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.936+0000 7f0c4e200640 1 -- 172.21.15.16:0/4144005644 wait complete. 2024-04-26T22:21:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 Processor -- start 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- start start 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48073d90 0x7f0c4809c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c480b8680 0x7f0c481e1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4814a800 con 0x7f0c480b66c0 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4814a680 con 0x7f0c480b8680 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c48154b60 con 0x7f0c48073d90 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56108/0 (socket says 172.21.15.16:56108) 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 -- 172.21.15.16:0/3319666548 learned_addr learned my addr 172.21.15.16:0/3319666548 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c47e00640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c480b8680 0x7f0c481e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c47400640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48073d90 0x7f0c4809c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 -- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48073d90 msgr2=0x7f0c4809c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48073d90 0x7f0c4809c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 -- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c480b8680 msgr2=0x7f0c481e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c480b8680 0x7f0c481e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 -- 172.21.15.16:0/3319666548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4809d860 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c46a00640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ae040 tx=0x7f0c340190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b8070 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c34004020 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340b0040 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c48143a00 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c48142840 con 0x7f0c480b66c0 2024-04-26T22:21:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.940+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c48069530 con 0x7f0c480b66c0 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.944+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c34003620 con 0x7f0c480b66c0 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.944+0000 7f0c3f400640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 0x7f0c2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.944+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c341205d0 con 0x7f0c480b66c0 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.944+0000 7f0c47400640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 0x7f0c2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.944+0000 7f0c47400640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 0x7f0c2806a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000f70 tx=0x7f0c38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:22.948+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c34015fb0 con 0x7f0c480b66c0 2024-04-26T22:21:23.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.116+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c480bac40 con 0x7f0c480b66c0 2024-04-26T22:21:23.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.116+0000 7f0c3f400640 1 -- 172.21.15.16:0/3319666548 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16606 (secure 0 0 0) 0x7f0c340f0b80 con 0x7f0c480b66c0 2024-04-26T22:21:23.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:23.119 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:21.782618+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:23.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 msgr2=0x7f0c2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 0x7f0c2806a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c38000f70 tx=0x7f0c38009040 comp rx=0 tx=0).stop 2024-04-26T22:21:23.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 msgr2=0x7f0c4813da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ae040 tx=0x7f0c340190d0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 shutdown_connections 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c28068380 0x7f0c2806a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c480b8680 0x7f0c481e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c480b66c0 0x7f0c4813da40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 --2- 172.21.15.16:0/3319666548 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c48073d90 0x7f0c4809c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 >> 172.21.15.16:0/3319666548 conn(0x7f0c4806f3d0 msgr2=0x7f0c480bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 shutdown_connections 2024-04-26T22:21:23.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.120+0000 7f0c4e200640 1 -- 172.21.15.16:0/3319666548 wait complete. 2024-04-26T22:21:23.140 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:21:23.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.280+0000 7f7a3dc00640 1 Processor -- start 2024-04-26T22:21:23.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 -- start start 2024-04-26T22:21:23.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 0x7f7a3813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a380b0a30 0x7f7a38140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a38070480 con 0x7f7a381464e0 2024-04-26T22:21:23.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7a38070a60 con 0x7f7a380b0a30 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a3dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a380718a0 con 0x7f7a3806e410 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a380b0a30 0x7f7a38140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a380b0a30 0x7f7a38140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56114/0 (socket says 172.21.15.16:56114) 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 -- 172.21.15.16:0/2028544085 learned_addr learned my addr 172.21.15.16:0/2028544085 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a36a00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 0x7f7a3813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 -- 172.21.15.16:0/2028544085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 msgr2=0x7f7a3813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 0x7f7a3813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 -- 172.21.15.16:0/2028544085 >> v1:172.21.15.195:6789/0 conn(0x7f7a381464e0 legacy=0x7f7a38146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:23.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a2fe00640 1 -- 172.21.15.16:0/2028544085 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3806e7f0 con 0x7f7a380b0a30 2024-04-26T22:21:23.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.284+0000 7f7a36a00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 0x7f7a3813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:23.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a2fe00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a380b0a30 0x7f7a38140510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367e0ac03ff05857 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a36000640 1 -- 172.21.15.16:0/2028544085 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a200ab640 con 0x7f7a380b0a30 2024-04-26T22:21:23.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a36000640 1 -- 172.21.15.16:0/2028544085 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a200b0070 con 0x7f7a380b0a30 2024-04-26T22:21:23.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a36000640 1 -- 172.21.15.16:0/2028544085 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a200aba00 con 0x7f7a380b0a30 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- 172.21.15.16:0/2028544085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a380b0a30 msgr2=0x7f7a38140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a380b0a30 0x7f7a38140510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2001c460 comp rx=0 tx=0).stop 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- 172.21.15.16:0/2028544085 shutdown_connections 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a380b0a30 0x7f7a38140510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/2028544085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a3806e410 0x7f7a3813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- 172.21.15.16:0/2028544085 >> 172.21.15.16:0/2028544085 conn(0x7f7a380b6590 msgr2=0x7f7a380b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- 172.21.15.16:0/2028544085 shutdown_connections 2024-04-26T22:21:23.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- 172.21.15.16:0/2028544085 wait complete. 2024-04-26T22:21:23.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 Processor -- start 2024-04-26T22:21:23.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.288+0000 7f7a3dc00640 1 -- start start 2024-04-26T22:21:23.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 0x7f7a38142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 0x7f7a3813d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38153520 con 0x7f7a381464e0 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381533a0 con 0x7f7a3806e410 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a381536a0 con 0x7f7a380b0a30 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56124/0 (socket says 172.21.15.16:56124) 2024-04-26T22:21:23.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 -- 172.21.15.16:0/3530498797 learned_addr learned my addr 172.21.15.16:0/3530498797 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 -- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 msgr2=0x7f7a3813d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a36a00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 0x7f7a38142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2fe00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 0x7f7a3813d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 0x7f7a3813d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 -- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 msgr2=0x7f7a38142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 0x7f7a38142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 -- 172.21.15.16:0/3530498797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a38142b20 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2fe00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 0x7f7a3813d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a36a00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 0x7f7a38142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a37400640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c780 tx=0x7f7a3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30004b70 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a30004d10 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a38073870 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000aa90 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3813d8c0 con 0x7f7a381464e0 2024-04-26T22:21:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a38069530 con 0x7f7a381464e0 2024-04-26T22:21:23.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.292+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a3000ac30 con 0x7f7a381464e0 2024-04-26T22:21:23.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.296+0000 7f7a2ea00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:23.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.296+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a30086c80 con 0x7f7a381464e0 2024-04-26T22:21:23.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.296+0000 7f7a36a00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.296+0000 7f7a36a00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 0x7f7a1406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a28008890 tx=0x7f7a28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:23.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.300+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a30020070 con 0x7f7a381464e0 2024-04-26T22:21:23.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:23.508+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7a3806cad0 con 0x7f7a381464e0 2024-04-26T22:21:24.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.408+0000 7f7a2ea00640 1 -- 172.21.15.16:0/3530498797 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f7a30057230 con 0x7f7a381464e0 2024-04-26T22:21:24.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 msgr2=0x7f7a1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 0x7f7a1406a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a28008890 tx=0x7f7a28008040 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 msgr2=0x7f7a38140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c780 tx=0x7f7a3000cc40 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 shutdown_connections 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a14068380 0x7f7a1406a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a381464e0 0x7f7a38140e70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a380b0a30 0x7f7a3813d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 --2- 172.21.15.16:0/3530498797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a3806e410 0x7f7a38142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 >> 172.21.15.16:0/3530498797 conn(0x7f7a380b6590 msgr2=0x7f7a380b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 shutdown_connections 2024-04-26T22:21:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.412+0000 7f7a3dc00640 1 -- 172.21.15.16:0/3530498797 wait complete. 2024-04-26T22:21:24.436 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:21:24.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:21:24.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 Processor -- start 2024-04-26T22:21:24.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 -- start start 2024-04-26T22:21:24.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f045006e410 0x7f045013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:24.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0450070480 con 0x7f0450146bf0 2024-04-26T22:21:24.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045006e7f0 con 0x7f04500b0a30 2024-04-26T22:21:24.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f0454c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0450070a60 con 0x7f045006e410 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f045006e410 0x7f045013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f045006e410 0x7f045013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41454/0 (socket says 172.21.15.16:41454) 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 -- 172.21.15.16:0/1452791679 learned_addr learned my addr 172.21.15.16:0/1452791679 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 -- 172.21.15.16:0/1452791679 >> v1:172.21.15.195:6789/0 conn(0x7f04500b0a30 legacy=0x7f04501464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 -- 172.21.15.16:0/1452791679 >> v1:172.21.15.16:6789/0 conn(0x7f0450146bf0 legacy=0x7f0450150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.584+0000 7f044de00640 1 -- 172.21.15.16:0/1452791679 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500706f0 con 0x7f045006e410 2024-04-26T22:21:24.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f044de00640 1 --2- 172.21.15.16:0/1452791679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f045006e410 0x7f045013ffd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8deff4b8d53dee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:24.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f044d400640 1 -- 172.21.15.16:0/1452791679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400a5620 con 0x7f045006e410 2024-04-26T22:21:24.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f044d400640 1 -- 172.21.15.16:0/1452791679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04400a57c0 con 0x7f045006e410 2024-04-26T22:21:24.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f044d400640 1 -- 172.21.15.16:0/1452791679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400a5b90 con 0x7f045006e410 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 -- 172.21.15.16:0/1452791679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f045006e410 msgr2=0x7f045013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 --2- 172.21.15.16:0/1452791679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f045006e410 0x7f045013ffd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044001c960 comp rx=0 tx=0).stop 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 -- 172.21.15.16:0/1452791679 shutdown_connections 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 --2- 172.21.15.16:0/1452791679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f045006e410 0x7f045013ffd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 -- 172.21.15.16:0/1452791679 >> 172.21.15.16:0/1452791679 conn(0x7f04500b6590 msgr2=0x7f04500b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 -- 172.21.15.16:0/1452791679 shutdown_connections 2024-04-26T22:21:24.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.588+0000 7f0454c00640 1 -- 172.21.15.16:0/1452791679 wait complete. 2024-04-26T22:21:24.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 Processor -- start 2024-04-26T22:21:24.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- start start 2024-04-26T22:21:24.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f045006e410 0x7f04501e4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0450146bf0 0x7f045013b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0450154c40 con 0x7f04500b0a30 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0450154ac0 con 0x7f0450146bf0 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0450154dc0 con 0x7f045006e410 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41456/0 (socket says 172.21.15.16:41456) 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 -- 172.21.15.16:0/2537998501 learned_addr learned my addr 172.21.15.16:0/2537998501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f044de00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f045006e410 0x7f04501e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f044e800640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0450146bf0 0x7f045013b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 -- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f045006e410 msgr2=0x7f04501e4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f045006e410 0x7f04501e4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 -- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0450146bf0 msgr2=0x7f045013b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:24.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0450146bf0 0x7f045013b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:24.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 -- 172.21.15.16:0/2537998501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500741b0 con 0x7f04500b0a30 2024-04-26T22:21:24.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0445400640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f043800c440 tx=0x7f043800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438016020 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0438012830 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04500737f0 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438012c20 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.592+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0450140bd0 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0450069530 con 0x7f04500b0a30 2024-04-26T22:21:24.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0438019020 con 0x7f04500b0a30 2024-04-26T22:21:24.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f0446a00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:24.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0438086620 con 0x7f04500b0a30 2024-04-26T22:21:24.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f044de00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:24.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.596+0000 7f044de00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 0x7f042c06a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04400ae000 tx=0x7f04400a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:24.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.600+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0438020030 con 0x7f04500b0a30 2024-04-26T22:21:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:24.804+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f045013b5d0 con 0x7f04500b0a30 2024-04-26T22:21:25.353 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-26T22:21:25.352+0000 7f8c4d600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:21:25.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0446a00640 1 -- 172.21.15.16:0/2537998501 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f0438003810 con 0x7f04500b0a30 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 msgr2=0x7f042c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 0x7f042c06a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04400ae000 tx=0x7f04400a7070 comp rx=0 tx=0).stop 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 msgr2=0x7f045013ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f043800c440 tx=0x7f043800c900 comp rx=0 tx=0).stop 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 shutdown_connections 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f042c0683b0 0x7f042c06a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0450146bf0 0x7f045013b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04500b0a30 0x7f045013ab50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 --2- 172.21.15.16:0/2537998501 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f045006e410 0x7f04501e4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 >> 172.21.15.16:0/2537998501 conn(0x7f04500b6590 msgr2=0x7f04500ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:25.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 shutdown_connections 2024-04-26T22:21:25.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.412+0000 7f0454c00640 1 -- 172.21.15.16:0/2537998501 wait complete. 2024-04-26T22:21:25.436 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:21:25.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:25.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.576+0000 7f1056600640 1 Processor -- start 2024-04-26T22:21:25.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.576+0000 7f1056600640 1 -- start start 2024-04-26T22:21:25.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1056600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f105006e450 0x7f10500b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1056600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105013ef30 0x7f105013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1056600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f105006e830 con 0x7f10501451f0 2024-04-26T22:21:25.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1056600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f10500b0d10 con 0x7f105013ef30 2024-04-26T22:21:25.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1056600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10500b0a30 con 0x7f105006e450 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105013ef30 0x7f105013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105013ef30 0x7f105013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41464/0 (socket says 172.21.15.16:41464) 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 -- 172.21.15.16:0/779464944 learned_addr learned my addr 172.21.15.16:0/779464944 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f104f400640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f105006e450 0x7f10500b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 -- 172.21.15.16:0/779464944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f105006e450 msgr2=0x7f10500b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f105006e450 0x7f10500b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 -- 172.21.15.16:0/779464944 >> v1:172.21.15.195:6789/0 conn(0x7f10501451f0 legacy=0x7f1050145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.580+0000 7f1046a00640 1 -- 172.21.15.16:0/779464944 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500b2cf0 con 0x7f105013ef30 2024-04-26T22:21:25.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1046a00640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105013ef30 0x7f105013f390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10500b0e90 tx=0x7f103801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290ae3ad6fa8460d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104ea00640 1 -- 172.21.15.16:0/779464944 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10380b1070 con 0x7f105013ef30 2024-04-26T22:21:25.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104ea00640 1 -- 172.21.15.16:0/779464944 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10380ac640 con 0x7f105013ef30 2024-04-26T22:21:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104ea00640 1 -- 172.21.15.16:0/779464944 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10380aca10 con 0x7f105013ef30 2024-04-26T22:21:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- 172.21.15.16:0/779464944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105013ef30 msgr2=0x7f105013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105013ef30 0x7f105013f390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10500b0e90 tx=0x7f103801c420 comp rx=0 tx=0).stop 2024-04-26T22:21:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- 172.21.15.16:0/779464944 shutdown_connections 2024-04-26T22:21:25.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105013ef30 0x7f105013f390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- 172.21.15.16:0/779464944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f105006e450 0x7f10500b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- 172.21.15.16:0/779464944 >> 172.21.15.16:0/779464944 conn(0x7f10500b6620 msgr2=0x7f10500b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:25.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- 172.21.15.16:0/779464944 shutdown_connections 2024-04-26T22:21:25.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- 172.21.15.16:0/779464944 wait complete. 2024-04-26T22:21:25.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 Processor -- start 2024-04-26T22:21:25.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- start start 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 0x7f10501e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10501451f0 0x7f105012fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10500b63e0 con 0x7f105006e450 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10500b6260 con 0x7f105013ef30 2024-04-26T22:21:25.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1056600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10500b2830 con 0x7f10501451f0 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41470/0 (socket says 172.21.15.16:41470) 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104f400640 1 -- 172.21.15.16:0/3997790514 learned_addr learned my addr 172.21.15.16:0/3997790514 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f1046a00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 0x7f10501e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.584+0000 7f104fe00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10501451f0 0x7f105012fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 -- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10501451f0 msgr2=0x7f105012fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10501451f0 0x7f105012fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 -- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 msgr2=0x7f10501e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 0x7f10501e14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 -- 172.21.15.16:0/3997790514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500b5b20 con 0x7f105006e450 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1046a00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 0x7f10501e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:25.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f104f400640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f104000d830 tx=0x7f104000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104000b6c0 con 0x7f105006e450 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1040019070 con 0x7f105006e450 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104000bae0 con 0x7f105006e450 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10501e0d00 con 0x7f105006e450 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10501e0fc0 con 0x7f105006e450 2024-04-26T22:21:25.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1050069530 con 0x7f105006e450 2024-04-26T22:21:25.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f104001e460 con 0x7f105006e450 2024-04-26T22:21:25.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f10400870e0 con 0x7f105006e450 2024-04-26T22:21:25.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.588+0000 7f1046a00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.592+0000 7f1046a00640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 0x7f102c06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10380ae000 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.592+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1040057690 con 0x7f105006e450 2024-04-26T22:21:25.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.792+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10501363d0 con 0x7f105006e450 2024-04-26T22:21:25.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.792+0000 7f1047e00640 1 -- 172.21.15.16:0/3997790514 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f1040056f90 con 0x7f105006e450 2024-04-26T22:21:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:25.795 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:25.795 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:25.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 msgr2=0x7f102c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 0x7f102c06a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10380ae000 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 msgr2=0x7f1050152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f104000d830 tx=0x7f104000dcf0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 shutdown_connections 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f102c0683b0 0x7f102c06a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10501451f0 0x7f105012fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f105013ef30 0x7f10501e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 --2- 172.21.15.16:0/3997790514 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105006e450 0x7f1050152800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 >> 172.21.15.16:0/3997790514 conn(0x7f10500b6620 msgr2=0x7f10500b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 shutdown_connections 2024-04-26T22:21:25.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.796+0000 7f1056600640 1 -- 172.21.15.16:0/3997790514 wait complete. 2024-04-26T22:21:25.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:25.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 Processor -- start 2024-04-26T22:21:25.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 -- start start 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f954809ba10 0x7f9548074590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 0x7f9548152e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9548142cc0 con 0x7f95480a04a0 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f95480bd890 con 0x7f954809ba10 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f95480a0880 con 0x7f954814bac0 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f9547e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f95480a04a0 0x7f95481425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59388/0 (socket says 172.21.15.16:59388) 2024-04-26T22:21:25.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f9547e00640 1 -- 172.21.15.16:0/3439927880 learned_addr learned my addr 172.21.15.16:0/3439927880 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f953f400640 1 --2- 172.21.15.16:0/3439927880 >> v2:172.21.15.195:3300/0 conn(0x7f954809ba10 0x7f9548074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954cc00640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 0x7f9548152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f9547400640 1 -- 172.21.15.16:0/3439927880 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063870945 0 0) 0x7f9548142cc0 con 0x7f95480a04a0 2024-04-26T22:21:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f9547400640 1 -- 172.21.15.16:0/3439927880 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f952c003530 con 0x7f95480a04a0 2024-04-26T22:21:25.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f953f400640 1 -- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 msgr2=0x7f9548152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:25.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f953f400640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 0x7f9548152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f953f400640 1 -- 172.21.15.16:0/3439927880 >> v1:172.21.15.16:6789/0 conn(0x7f95480a04a0 legacy=0x7f95481425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f953f400640 1 -- 172.21.15.16:0/3439927880 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95480bd090 con 0x7f954809ba10 2024-04-26T22:21:25.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.956+0000 7f954cc00640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 0x7f9548152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:25.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f953f400640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954809ba10 0x7f9548074590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95300097c0 tx=0x7f953001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84a9bcb234a1f513 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f9547400640 1 -- 172.21.15.16:0/3439927880 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95300b2070 con 0x7f954809ba10 2024-04-26T22:21:25.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f9547400640 1 -- 172.21.15.16:0/3439927880 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95300ad680 con 0x7f954809ba10 2024-04-26T22:21:25.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f9547400640 1 -- 172.21.15.16:0/3439927880 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95300ada30 con 0x7f954809ba10 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 -- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954809ba10 msgr2=0x7f9548074590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954809ba10 0x7f9548074590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95300097c0 tx=0x7f953001c470 comp rx=0 tx=0).stop 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 -- 172.21.15.16:0/3439927880 shutdown_connections 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f954814bac0 0x7f9548152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 --2- 172.21.15.16:0/3439927880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954809ba10 0x7f9548074590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 -- 172.21.15.16:0/3439927880 >> 172.21.15.16:0/3439927880 conn(0x7f9548068740 msgr2=0x7f954809fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 -- 172.21.15.16:0/3439927880 shutdown_connections 2024-04-26T22:21:25.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 -- 172.21.15.16:0/3439927880 wait complete. 2024-04-26T22:21:25.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.960+0000 7f954ec00640 1 Processor -- start 2024-04-26T22:21:25.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- start start 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95480a04a0 0x7f95481e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954814bac0 0x7f9548146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9548155d10 con 0x7f954809ba10 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9548155b90 con 0x7f954814bac0 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9548155e90 con 0x7f95480a04a0 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41478/0 (socket says 172.21.15.16:41478) 2024-04-26T22:21:25.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 -- 172.21.15.16:0/3878012607 learned_addr learned my addr 172.21.15.16:0/3878012607 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:25.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 -- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95480a04a0 msgr2=0x7f95481e1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95480a04a0 0x7f95481e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 -- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954814bac0 msgr2=0x7f9548146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954814bac0 0x7f9548146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 -- 172.21.15.16:0/3878012607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9548148900 con 0x7f954809ba10 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9547e00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f953800cb40 tx=0x7f953800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538017070 con 0x7f954809ba10 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953800aca0 con 0x7f954809ba10 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95481e12a0 con 0x7f954809ba10 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538012620 con 0x7f954809ba10 2024-04-26T22:21:25.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95480b8080 con 0x7f954809ba10 2024-04-26T22:21:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9548069530 con 0x7f954809ba10 2024-04-26T22:21:25.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.964+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f953801a070 con 0x7f954809ba10 2024-04-26T22:21:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.968+0000 7f9544c00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 0x7f952406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.968+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9538086800 con 0x7f954809ba10 2024-04-26T22:21:25.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.968+0000 7f953f400640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 0x7f952406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:25.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.968+0000 7f953f400640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 0x7f952406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95300af000 tx=0x7f9530004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:25.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:25.972+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9538056db0 con 0x7f954809ba10 2024-04-26T22:21:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.136+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f954809fed0 con 0x7f954809ba10 2024-04-26T22:21:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.136+0000 7f9544c00640 1 -- 172.21.15.16:0/3878012607 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f95380566b0 con 0x7f954809ba10 2024-04-26T22:21:26.138 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:26.138 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:26.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 msgr2=0x7f952406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 0x7f952406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95300af000 tx=0x7f9530004740 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 msgr2=0x7f954813f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f953800cb40 tx=0x7f953800a060 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 shutdown_connections 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9524068380 0x7f952406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f954814bac0 0x7f9548146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95480a04a0 0x7f95481e1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 --2- 172.21.15.16:0/3878012607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f954809ba10 0x7f954813f2b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 >> 172.21.15.16:0/3878012607 conn(0x7f9548068740 msgr2=0x7f95480bde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 shutdown_connections 2024-04-26T22:21:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.140+0000 7f954ec00640 1 -- 172.21.15.16:0/3878012607 wait complete. 2024-04-26T22:21:26.161 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:21:26.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:21:26.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 Processor -- start 2024-04-26T22:21:26.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 -- start start 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca4c0b0ac0 0x7fca4c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c0b3f50 con 0x7fca4c0b58d0 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fca4c0b3310 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca53e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c070790 con 0x7fca4c06e450 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca50a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fca4c0b58d0 0x7fca4c140060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59394/0 (socket says 172.21.15.16:59394) 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca50a00640 1 -- 172.21.15.16:0/3292357719 learned_addr learned my addr 172.21.15.16:0/3292357719 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca51e00640 1 --2- 172.21.15.16:0/3292357719 >> v2:172.21.15.16:3300/0 conn(0x7fca4c0b0ac0 0x7fca4c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.300+0000 7fca51400640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca4be00640 1 -- 172.21.15.16:0/3292357719 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326576674 0 0) 0x7fca4c0b3f50 con 0x7fca4c0b58d0 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca4be00640 1 -- 172.21.15.16:0/3292357719 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003530 con 0x7fca4c0b58d0 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca51e00640 1 -- 172.21.15.16:0/3292357719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 msgr2=0x7fca4c0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca51e00640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca51e00640 1 -- 172.21.15.16:0/3292357719 >> v1:172.21.15.16:6789/0 conn(0x7fca4c0b58d0 legacy=0x7fca4c140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca51e00640 1 -- 172.21.15.16:0/3292357719 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c06e830 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca51e00640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c150b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca44009d90 tx=0x7fca4401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb50b4aa11ca982e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca4be00640 1 -- 172.21.15.16:0/3292357719 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440b2070 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca4be00640 1 -- 172.21.15.16:0/3292357719 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca440a5970 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca4be00640 1 -- 172.21.15.16:0/3292357719 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440a5d40 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 -- 172.21.15.16:0/3292357719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 msgr2=0x7fca4c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c150b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca44009d90 tx=0x7fca4401c8b0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 -- 172.21.15.16:0/3292357719 shutdown_connections 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c150b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 --2- 172.21.15.16:0/3292357719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 -- 172.21.15.16:0/3292357719 >> 172.21.15.16:0/3292357719 conn(0x7fca4c0b6620 msgr2=0x7fca4c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:26.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 -- 172.21.15.16:0/3292357719 shutdown_connections 2024-04-26T22:21:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.304+0000 7fca53e00640 1 -- 172.21.15.16:0/3292357719 wait complete. 2024-04-26T22:21:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 Processor -- start 2024-04-26T22:21:26.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- start start 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca4c0b58d0 0x7fca4c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c153a30 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c1538b0 con 0x7fca4c0b58d0 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c153bb0 con 0x7fca4c06e450 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41490/0 (socket says 172.21.15.16:41490) 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 -- 172.21.15.16:0/1707013837 learned_addr learned my addr 172.21.15.16:0/1707013837 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:26.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca51e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca4c0b58d0 0x7fca4c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca51400640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 -- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 msgr2=0x7fca4c136540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c136540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 -- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca4c0b58d0 msgr2=0x7fca4c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca4c0b58d0 0x7fca4c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 -- 172.21.15.16:0/1707013837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c0b25b0 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca50a00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c3c0 tx=0x7fca3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38017070 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca38005cf0 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380072f0 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c0b2890 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.308+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c0afb10 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca4c069530 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca3801a070 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca49600640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 0x7fca2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca38085df0 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca51400640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 0x7fca2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.312+0000 7fca51400640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 0x7fca2c06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca40009af0 tx=0x7fca40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.316+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fca38056310 con 0x7fca4c0b0ac0 2024-04-26T22:21:26.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.476+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca4c0b5570 con 0x7fca2c068380 2024-04-26T22:21:26.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.488+0000 7fca49600640 1 -- 172.21.15.16:0/1707013837 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251897 (secure 0 0 0) 0x7fca4c0b5570 con 0x7fca2c068380 2024-04-26T22:21:26.491 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:26.492 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:21:26.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 msgr2=0x7fca2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 0x7fca2c06a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca40009af0 tx=0x7fca40008040 comp rx=0 tx=0).stop 2024-04-26T22:21:26.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 msgr2=0x7fca4c0b7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c3c0 tx=0x7fca3800c880 comp rx=0 tx=0).stop 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 shutdown_connections 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fca2c068380 0x7fca2c06a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fca4c0b58d0 0x7fca4c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca4c0b0ac0 0x7fca4c0b7dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 --2- 172.21.15.16:0/1707013837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fca4c06e450 0x7fca4c136540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 >> 172.21.15.16:0/1707013837 conn(0x7fca4c0b6620 msgr2=0x7fca4c13e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 shutdown_connections 2024-04-26T22:21:26.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.492+0000 7fca53e00640 1 -- 172.21.15.16:0/1707013837 wait complete. 2024-04-26T22:21:26.512 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T22:21:26.101839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248156,"kb_used_data":2880,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726564,"statfs":{"total":773094113280,"available":772840001536,"internally_reserved":0,"allocated":2949120,"data_stored":1758028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.731969"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411829+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:22.411829+0000","last_peered":"2024-04-26T22:21:22.411829+0000","last_clean":"2024-04-26T22:21:22.411829+0000","last_became_active":"2024-04-26T22:21:22.404969+0000","last_became_peered":"2024-04-26T22:21:22.404969+0000","last_unstale":"2024-04-26T22:21:22.411829+0000","last_undegraded":"2024-04-26T22:21:22.411829+0000","last_fullsized":"2024-04-26T22:21:22.411829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412521+0000","last_change":"2024-04-26T22:21:22.419853+0000","last_active":"2024-04-26T22:21:23.412521+0000","last_peered":"2024-04-26T22:21:23.412521+0000","last_clean":"2024-04-26T22:21:23.412521+0000","last_became_active":"2024-04-26T22:21:22.419507+0000","last_became_peered":"2024-04-26T22:21:22.419507+0000","last_unstale":"2024-04-26T22:21:23.412521+0000","last_undegraded":"2024-04-26T22:21:23.412521+0000","last_fullsized":"2024-04-26T22:21:23.412521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.417849+0000","last_change":"2024-04-26T22:21:22.402773+0000","last_active":"2024-04-26T22:21:22.417849+0000","last_peered":"2024-04-26T22:21:22.417849+0000","last_clean":"2024-04-26T22:21:22.417849+0000","last_became_active":"2024-04-26T22:21:22.402398+0000","last_became_peered":"2024-04-26T22:21:22.402398+0000","last_unstale":"2024-04-26T22:21:22.417849+0000","last_undegraded":"2024-04-26T22:21:22.417849+0000","last_fullsized":"2024-04-26T22:21:22.417849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:16.130596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425659+0000","last_change":"2024-04-26T22:21:22.419823+0000","last_active":"2024-04-26T22:21:22.425659+0000","last_peered":"2024-04-26T22:21:22.425659+0000","last_clean":"2024-04-26T22:21:22.425659+0000","last_became_active":"2024-04-26T22:21:22.419566+0000","last_became_peered":"2024-04-26T22:21:22.419566+0000","last_unstale":"2024-04-26T22:21:22.425659+0000","last_undegraded":"2024-04-26T22:21:22.425659+0000","last_fullsized":"2024-04-26T22:21:22.425659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410446+0000","last_change":"2024-04-26T22:21:22.406403+0000","last_active":"2024-04-26T22:21:22.410446+0000","last_peered":"2024-04-26T22:21:22.410446+0000","last_clean":"2024-04-26T22:21:22.410446+0000","last_became_active":"2024-04-26T22:21:22.406043+0000","last_became_peered":"2024-04-26T22:21:22.406043+0000","last_unstale":"2024-04-26T22:21:22.410446+0000","last_undegraded":"2024-04-26T22:21:22.410446+0000","last_fullsized":"2024-04-26T22:21:22.410446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426178+0000","last_change":"2024-04-26T22:21:22.414425+0000","last_active":"2024-04-26T22:21:22.426178+0000","last_peered":"2024-04-26T22:21:22.426178+0000","last_clean":"2024-04-26T22:21:22.426178+0000","last_became_active":"2024-04-26T22:21:22.414091+0000","last_became_peered":"2024-04-26T22:21:22.414091+0000","last_unstale":"2024-04-26T22:21:22.426178+0000","last_undegraded":"2024-04-26T22:21:22.426178+0000","last_fullsized":"2024-04-26T22:21:22.426178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:46.636579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.419517+0000","last_change":"2024-04-26T22:21:22.416374+0000","last_active":"2024-04-26T22:21:22.419517+0000","last_peered":"2024-04-26T22:21:22.419517+0000","last_clean":"2024-04-26T22:21:22.419517+0000","last_became_active":"2024-04-26T22:21:22.415971+0000","last_became_peered":"2024-04-26T22:21:22.415971+0000","last_unstale":"2024-04-26T22:21:22.419517+0000","last_undegraded":"2024-04-26T22:21:22.419517+0000","last_fullsized":"2024-04-26T22:21:22.419517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431283+0000","last_change":"2024-04-26T22:21:22.426064+0000","last_active":"2024-04-26T22:21:22.431283+0000","last_peered":"2024-04-26T22:21:22.431283+0000","last_clean":"2024-04-26T22:21:22.431283+0000","last_became_active":"2024-04-26T22:21:22.425772+0000","last_became_peered":"2024-04-26T22:21:22.425772+0000","last_unstale":"2024-04-26T22:21:22.431283+0000","last_undegraded":"2024-04-26T22:21:22.431283+0000","last_fullsized":"2024-04-26T22:21:22.431283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:46.636579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.421853+0000","last_change":"2024-04-26T22:21:22.419613+0000","last_active":"2024-04-26T22:21:22.421853+0000","last_peered":"2024-04-26T22:21:22.421853+0000","last_clean":"2024-04-26T22:21:22.421853+0000","last_became_active":"2024-04-26T22:21:22.419007+0000","last_became_peered":"2024-04-26T22:21:22.419007+0000","last_unstale":"2024-04-26T22:21:22.421853+0000","last_undegraded":"2024-04-26T22:21:22.421853+0000","last_fullsized":"2024-04-26T22:21:22.421853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409029+0000","last_change":"2024-04-26T22:21:22.423811+0000","last_active":"2024-04-26T22:21:23.409029+0000","last_peered":"2024-04-26T22:21:23.409029+0000","last_clean":"2024-04-26T22:21:23.409029+0000","last_became_active":"2024-04-26T22:21:22.418209+0000","last_became_peered":"2024-04-26T22:21:22.418209+0000","last_unstale":"2024-04-26T22:21:23.409029+0000","last_undegraded":"2024-04-26T22:21:23.409029+0000","last_fullsized":"2024-04-26T22:21:23.409029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408471+0000","last_change":"2024-04-26T22:21:22.417717+0000","last_active":"2024-04-26T22:21:23.408471+0000","last_peered":"2024-04-26T22:21:23.408471+0000","last_clean":"2024-04-26T22:21:23.408471+0000","last_became_active":"2024-04-26T22:21:22.417411+0000","last_became_peered":"2024-04-26T22:21:22.417411+0000","last_unstale":"2024-04-26T22:21:23.408471+0000","last_undegraded":"2024-04-26T22:21:23.408471+0000","last_fullsized":"2024-04-26T22:21:23.408471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409203+0000","last_change":"2024-04-26T22:21:22.399958+0000","last_active":"2024-04-26T22:21:23.409203+0000","last_peered":"2024-04-26T22:21:23.409203+0000","last_clean":"2024-04-26T22:21:23.409203+0000","last_became_active":"2024-04-26T22:21:22.398263+0000","last_became_peered":"2024-04-26T22:21:22.398263+0000","last_unstale":"2024-04-26T22:21:23.409203+0000","last_undegraded":"2024-04-26T22:21:23.409203+0000","last_fullsized":"2024-04-26T22:21:23.409203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.408395+0000","last_change":"2024-04-26T22:21:22.401315+0000","last_active":"2024-04-26T22:21:22.408395+0000","last_peered":"2024-04-26T22:21:22.408395+0000","last_clean":"2024-04-26T22:21:22.408395+0000","last_became_active":"2024-04-26T22:21:22.401055+0000","last_became_peered":"2024-04-26T22:21:22.401055+0000","last_unstale":"2024-04-26T22:21:22.408395+0000","last_undegraded":"2024-04-26T22:21:22.408395+0000","last_fullsized":"2024-04-26T22:21:22.408395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:59.988603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411302+0000","last_change":"2024-04-26T22:21:22.401017+0000","last_active":"2024-04-26T22:21:22.411302+0000","last_peered":"2024-04-26T22:21:22.411302+0000","last_clean":"2024-04-26T22:21:22.411302+0000","last_became_active":"2024-04-26T22:21:22.400740+0000","last_became_peered":"2024-04-26T22:21:22.400740+0000","last_unstale":"2024-04-26T22:21:22.411302+0000","last_undegraded":"2024-04-26T22:21:22.411302+0000","last_fullsized":"2024-04-26T22:21:22.411302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:39.110847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412340+0000","last_change":"2024-04-26T22:21:22.391216+0000","last_active":"2024-04-26T22:21:23.412340+0000","last_peered":"2024-04-26T22:21:23.412340+0000","last_clean":"2024-04-26T22:21:23.412340+0000","last_became_active":"2024-04-26T22:21:22.390914+0000","last_became_peered":"2024-04-26T22:21:22.390914+0000","last_unstale":"2024-04-26T22:21:23.412340+0000","last_undegraded":"2024-04-26T22:21:23.412340+0000","last_fullsized":"2024-04-26T22:21:23.412340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424838+0000","last_change":"2024-04-26T22:21:22.415179+0000","last_active":"2024-04-26T22:21:22.424838+0000","last_peered":"2024-04-26T22:21:22.424838+0000","last_clean":"2024-04-26T22:21:22.424838+0000","last_became_active":"2024-04-26T22:21:22.414894+0000","last_became_peered":"2024-04-26T22:21:22.414894+0000","last_unstale":"2024-04-26T22:21:22.424838+0000","last_undegraded":"2024-04-26T22:21:22.424838+0000","last_fullsized":"2024-04-26T22:21:22.424838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:08.502863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425474+0000","last_change":"2024-04-26T22:21:22.414418+0000","last_active":"2024-04-26T22:21:22.425474+0000","last_peered":"2024-04-26T22:21:22.425474+0000","last_clean":"2024-04-26T22:21:22.425474+0000","last_became_active":"2024-04-26T22:21:22.413203+0000","last_became_peered":"2024-04-26T22:21:22.413203+0000","last_unstale":"2024-04-26T22:21:22.425474+0000","last_undegraded":"2024-04-26T22:21:22.425474+0000","last_fullsized":"2024-04-26T22:21:22.425474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:39.508019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408121+0000","last_change":"2024-04-26T22:21:22.406821+0000","last_active":"2024-04-26T22:21:23.408121+0000","last_peered":"2024-04-26T22:21:23.408121+0000","last_clean":"2024-04-26T22:21:23.408121+0000","last_became_active":"2024-04-26T22:21:22.406613+0000","last_became_peered":"2024-04-26T22:21:22.406613+0000","last_unstale":"2024-04-26T22:21:23.408121+0000","last_undegraded":"2024-04-26T22:21:23.408121+0000","last_fullsized":"2024-04-26T22:21:23.408121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.412567+0000","last_change":"2024-04-26T22:21:22.410515+0000","last_active":"2024-04-26T22:21:22.412567+0000","last_peered":"2024-04-26T22:21:22.412567+0000","last_clean":"2024-04-26T22:21:22.412567+0000","last_became_active":"2024-04-26T22:21:22.410219+0000","last_became_peered":"2024-04-26T22:21:22.410219+0000","last_unstale":"2024-04-26T22:21:22.412567+0000","last_undegraded":"2024-04-26T22:21:22.412567+0000","last_fullsized":"2024-04-26T22:21:22.412567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409256+0000","last_change":"2024-04-26T22:21:22.407928+0000","last_active":"2024-04-26T22:21:23.409256+0000","last_peered":"2024-04-26T22:21:23.409256+0000","last_clean":"2024-04-26T22:21:23.409256+0000","last_became_active":"2024-04-26T22:21:22.407586+0000","last_became_peered":"2024-04-26T22:21:22.407586+0000","last_unstale":"2024-04-26T22:21:23.409256+0000","last_undegraded":"2024-04-26T22:21:23.409256+0000","last_fullsized":"2024-04-26T22:21:23.409256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423227+0000","last_change":"2024-04-26T22:21:22.415479+0000","last_active":"2024-04-26T22:21:22.423227+0000","last_peered":"2024-04-26T22:21:22.423227+0000","last_clean":"2024-04-26T22:21:22.423227+0000","last_became_active":"2024-04-26T22:21:22.415221+0000","last_became_peered":"2024-04-26T22:21:22.415221+0000","last_unstale":"2024-04-26T22:21:22.423227+0000","last_undegraded":"2024-04-26T22:21:22.423227+0000","last_fullsized":"2024-04-26T22:21:22.423227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:03.847233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426160+0000","last_change":"2024-04-26T22:21:22.412956+0000","last_active":"2024-04-26T22:21:22.426160+0000","last_peered":"2024-04-26T22:21:22.426160+0000","last_clean":"2024-04-26T22:21:22.426160+0000","last_became_active":"2024-04-26T22:21:22.412717+0000","last_became_peered":"2024-04-26T22:21:22.412717+0000","last_unstale":"2024-04-26T22:21:22.426160+0000","last_undegraded":"2024-04-26T22:21:22.426160+0000","last_fullsized":"2024-04-26T22:21:22.426160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:22.345268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.418241+0000","last_change":"2024-04-26T22:21:22.410307+0000","last_active":"2024-04-26T22:21:22.418241+0000","last_peered":"2024-04-26T22:21:22.418241+0000","last_clean":"2024-04-26T22:21:22.418241+0000","last_became_active":"2024-04-26T22:21:22.410111+0000","last_became_peered":"2024-04-26T22:21:22.410111+0000","last_unstale":"2024-04-26T22:21:22.418241+0000","last_undegraded":"2024-04-26T22:21:22.418241+0000","last_fullsized":"2024-04-26T22:21:22.418241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.428647+0000","last_change":"2024-04-26T22:21:22.427712+0000","last_active":"2024-04-26T22:21:22.428647+0000","last_peered":"2024-04-26T22:21:22.428647+0000","last_clean":"2024-04-26T22:21:22.428647+0000","last_became_active":"2024-04-26T22:21:22.427358+0000","last_became_peered":"2024-04-26T22:21:22.427358+0000","last_unstale":"2024-04-26T22:21:22.428647+0000","last_undegraded":"2024-04-26T22:21:22.428647+0000","last_fullsized":"2024-04-26T22:21:22.428647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.427940+0000","last_change":"2024-04-26T22:21:22.412148+0000","last_active":"2024-04-26T22:21:22.427940+0000","last_peered":"2024-04-26T22:21:22.427940+0000","last_clean":"2024-04-26T22:21:22.427940+0000","last_became_active":"2024-04-26T22:21:22.411380+0000","last_became_peered":"2024-04-26T22:21:22.411380+0000","last_unstale":"2024-04-26T22:21:22.427940+0000","last_undegraded":"2024-04-26T22:21:22.427940+0000","last_fullsized":"2024-04-26T22:21:22.427940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409175+0000","last_change":"2024-04-26T22:21:22.412872+0000","last_active":"2024-04-26T22:21:23.409175+0000","last_peered":"2024-04-26T22:21:23.409175+0000","last_clean":"2024-04-26T22:21:23.409175+0000","last_became_active":"2024-04-26T22:21:22.412429+0000","last_became_peered":"2024-04-26T22:21:22.412429+0000","last_unstale":"2024-04-26T22:21:23.409175+0000","last_undegraded":"2024-04-26T22:21:23.409175+0000","last_fullsized":"2024-04-26T22:21:23.409175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412454+0000","last_change":"2024-04-26T22:21:22.403344+0000","last_active":"2024-04-26T22:21:23.412454+0000","last_peered":"2024-04-26T22:21:23.412454+0000","last_clean":"2024-04-26T22:21:23.412454+0000","last_became_active":"2024-04-26T22:21:22.403042+0000","last_became_peered":"2024-04-26T22:21:22.403042+0000","last_unstale":"2024-04-26T22:21:23.412454+0000","last_undegraded":"2024-04-26T22:21:23.412454+0000","last_fullsized":"2024-04-26T22:21:23.412454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.418714+0000","last_change":"2024-04-26T22:21:22.411698+0000","last_active":"2024-04-26T22:21:22.418714+0000","last_peered":"2024-04-26T22:21:22.418714+0000","last_clean":"2024-04-26T22:21:22.418714+0000","last_became_active":"2024-04-26T22:21:22.410959+0000","last_became_peered":"2024-04-26T22:21:22.410959+0000","last_unstale":"2024-04-26T22:21:22.418714+0000","last_undegraded":"2024-04-26T22:21:22.418714+0000","last_fullsized":"2024-04-26T22:21:22.418714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423211+0000","last_change":"2024-04-26T22:21:22.414909+0000","last_active":"2024-04-26T22:21:22.423211+0000","last_peered":"2024-04-26T22:21:22.423211+0000","last_clean":"2024-04-26T22:21:22.423211+0000","last_became_active":"2024-04-26T22:21:22.412967+0000","last_became_peered":"2024-04-26T22:21:22.412967+0000","last_unstale":"2024-04-26T22:21:22.423211+0000","last_undegraded":"2024-04-26T22:21:22.423211+0000","last_fullsized":"2024-04-26T22:21:22.423211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:49.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426140+0000","last_change":"2024-04-26T22:21:22.412771+0000","last_active":"2024-04-26T22:21:22.426140+0000","last_peered":"2024-04-26T22:21:22.426140+0000","last_clean":"2024-04-26T22:21:22.426140+0000","last_became_active":"2024-04-26T22:21:22.412269+0000","last_became_peered":"2024-04-26T22:21:22.412269+0000","last_unstale":"2024-04-26T22:21:22.426140+0000","last_undegraded":"2024-04-26T22:21:22.426140+0000","last_fullsized":"2024-04-26T22:21:22.426140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408052+0000","last_change":"2024-04-26T22:21:22.420475+0000","last_active":"2024-04-26T22:21:23.408052+0000","last_peered":"2024-04-26T22:21:23.408052+0000","last_clean":"2024-04-26T22:21:23.408052+0000","last_became_active":"2024-04-26T22:21:22.420224+0000","last_became_peered":"2024-04-26T22:21:22.420224+0000","last_unstale":"2024-04-26T22:21:23.408052+0000","last_undegraded":"2024-04-26T22:21:23.408052+0000","last_fullsized":"2024-04-26T22:21:23.408052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408065+0000","last_change":"2024-04-26T22:21:22.417961+0000","last_active":"2024-04-26T22:21:23.408065+0000","last_peered":"2024-04-26T22:21:23.408065+0000","last_clean":"2024-04-26T22:21:23.408065+0000","last_became_active":"2024-04-26T22:21:22.417173+0000","last_became_peered":"2024-04-26T22:21:22.417173+0000","last_unstale":"2024-04-26T22:21:23.408065+0000","last_undegraded":"2024-04-26T22:21:23.408065+0000","last_fullsized":"2024-04-26T22:21:23.408065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409653+0000","last_change":"2024-04-26T22:21:22.399070+0000","last_active":"2024-04-26T22:21:23.409653+0000","last_peered":"2024-04-26T22:21:23.409653+0000","last_clean":"2024-04-26T22:21:23.409653+0000","last_became_active":"2024-04-26T22:21:22.398182+0000","last_became_peered":"2024-04-26T22:21:22.398182+0000","last_unstale":"2024-04-26T22:21:23.409653+0000","last_undegraded":"2024-04-26T22:21:23.409653+0000","last_fullsized":"2024-04-26T22:21:23.409653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.430184+0000","last_change":"2024-04-26T22:21:21.400248+0000","last_active":"2024-04-26T22:21:22.430184+0000","last_peered":"2024-04-26T22:21:22.430184+0000","last_clean":"2024-04-26T22:21:22.430184+0000","last_became_active":"2024-04-26T22:21:21.399953+0000","last_became_peered":"2024-04-26T22:21:21.399953+0000","last_unstale":"2024-04-26T22:21:22.430184+0000","last_undegraded":"2024-04-26T22:21:22.430184+0000","last_fullsized":"2024-04-26T22:21:22.430184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423190+0000","last_change":"2024-04-26T22:21:22.414633+0000","last_active":"2024-04-26T22:21:22.423190+0000","last_peered":"2024-04-26T22:21:22.423190+0000","last_clean":"2024-04-26T22:21:22.423190+0000","last_became_active":"2024-04-26T22:21:22.414387+0000","last_became_peered":"2024-04-26T22:21:22.414387+0000","last_unstale":"2024-04-26T22:21:22.423190+0000","last_undegraded":"2024-04-26T22:21:22.423190+0000","last_fullsized":"2024-04-26T22:21:22.423190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:11.015287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408260+0000","last_change":"2024-04-26T22:21:21.400875+0000","last_active":"2024-04-26T22:21:23.408260+0000","last_peered":"2024-04-26T22:21:23.408260+0000","last_clean":"2024-04-26T22:21:23.408260+0000","last_became_active":"2024-04-26T22:21:21.400561+0000","last_became_peered":"2024-04-26T22:21:21.400561+0000","last_unstale":"2024-04-26T22:21:23.408260+0000","last_undegraded":"2024-04-26T22:21:23.408260+0000","last_fullsized":"2024-04-26T22:21:23.408260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395555+0000","last_change":"2024-04-26T22:21:21.395724+0000","last_active":"2024-04-26T22:21:22.395555+0000","last_peered":"2024-04-26T22:21:22.395555+0000","last_clean":"2024-04-26T22:21:22.395555+0000","last_became_active":"2024-04-26T22:21:21.395270+0000","last_became_peered":"2024-04-26T22:21:21.395270+0000","last_unstale":"2024-04-26T22:21:22.395555+0000","last_undegraded":"2024-04-26T22:21:22.395555+0000","last_fullsized":"2024-04-26T22:21:22.395555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431257+0000","last_change":"2024-04-26T22:21:22.425600+0000","last_active":"2024-04-26T22:21:22.431257+0000","last_peered":"2024-04-26T22:21:22.431257+0000","last_clean":"2024-04-26T22:21:22.431257+0000","last_became_active":"2024-04-26T22:21:22.420621+0000","last_became_peered":"2024-04-26T22:21:22.420621+0000","last_unstale":"2024-04-26T22:21:22.431257+0000","last_undegraded":"2024-04-26T22:21:22.431257+0000","last_fullsized":"2024-04-26T22:21:22.431257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:22.345268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.404021+0000","last_change":"2024-04-26T22:21:21.396563+0000","last_active":"2024-04-26T22:21:22.404021+0000","last_peered":"2024-04-26T22:21:22.404021+0000","last_clean":"2024-04-26T22:21:22.404021+0000","last_became_active":"2024-04-26T22:21:21.393730+0000","last_became_peered":"2024-04-26T22:21:21.393730+0000","last_unstale":"2024-04-26T22:21:22.404021+0000","last_undegraded":"2024-04-26T22:21:22.404021+0000","last_fullsized":"2024-04-26T22:21:22.404021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412421+0000","last_change":"2024-04-26T22:21:22.399913+0000","last_active":"2024-04-26T22:21:23.412421+0000","last_peered":"2024-04-26T22:21:23.412421+0000","last_clean":"2024-04-26T22:21:23.412421+0000","last_became_active":"2024-04-26T22:21:22.399633+0000","last_became_peered":"2024-04-26T22:21:22.399633+0000","last_unstale":"2024-04-26T22:21:23.412421+0000","last_undegraded":"2024-04-26T22:21:23.412421+0000","last_fullsized":"2024-04-26T22:21:23.412421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408864+0000","last_change":"2024-04-26T22:21:21.401808+0000","last_active":"2024-04-26T22:21:23.408864+0000","last_peered":"2024-04-26T22:21:23.408864+0000","last_clean":"2024-04-26T22:21:23.408864+0000","last_became_active":"2024-04-26T22:21:21.401323+0000","last_became_peered":"2024-04-26T22:21:21.401323+0000","last_unstale":"2024-04-26T22:21:23.408864+0000","last_undegraded":"2024-04-26T22:21:23.408864+0000","last_fullsized":"2024-04-26T22:21:23.408864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425008+0000","last_change":"2024-04-26T22:21:22.416004+0000","last_active":"2024-04-26T22:21:22.425008+0000","last_peered":"2024-04-26T22:21:22.425008+0000","last_clean":"2024-04-26T22:21:22.425008+0000","last_became_active":"2024-04-26T22:21:22.415730+0000","last_became_peered":"2024-04-26T22:21:22.415730+0000","last_unstale":"2024-04-26T22:21:22.425008+0000","last_undegraded":"2024-04-26T22:21:22.425008+0000","last_fullsized":"2024-04-26T22:21:22.425008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.396462+0000","last_change":"2024-04-26T22:21:21.403091+0000","last_active":"2024-04-26T22:21:22.396462+0000","last_peered":"2024-04-26T22:21:22.396462+0000","last_clean":"2024-04-26T22:21:22.396462+0000","last_became_active":"2024-04-26T22:21:21.402767+0000","last_became_peered":"2024-04-26T22:21:21.402767+0000","last_unstale":"2024-04-26T22:21:22.396462+0000","last_undegraded":"2024-04-26T22:21:22.396462+0000","last_fullsized":"2024-04-26T22:21:22.396462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424088+0000","last_change":"2024-04-26T22:21:22.421952+0000","last_active":"2024-04-26T22:21:22.424088+0000","last_peered":"2024-04-26T22:21:22.424088+0000","last_clean":"2024-04-26T22:21:22.424088+0000","last_became_active":"2024-04-26T22:21:22.421689+0000","last_became_peered":"2024-04-26T22:21:22.421689+0000","last_unstale":"2024-04-26T22:21:22.424088+0000","last_undegraded":"2024-04-26T22:21:22.424088+0000","last_fullsized":"2024-04-26T22:21:22.424088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:44.987098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412426+0000","last_change":"2024-04-26T22:21:21.410257+0000","last_active":"2024-04-26T22:21:23.412426+0000","last_peered":"2024-04-26T22:21:23.412426+0000","last_clean":"2024-04-26T22:21:23.412426+0000","last_became_active":"2024-04-26T22:21:21.409894+0000","last_became_peered":"2024-04-26T22:21:21.409894+0000","last_unstale":"2024-04-26T22:21:23.412426+0000","last_undegraded":"2024-04-26T22:21:23.412426+0000","last_fullsized":"2024-04-26T22:21:23.412426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409320+0000","last_change":"2024-04-26T22:21:22.404687+0000","last_active":"2024-04-26T22:21:23.409320+0000","last_peered":"2024-04-26T22:21:23.409320+0000","last_clean":"2024-04-26T22:21:23.409320+0000","last_became_active":"2024-04-26T22:21:22.404406+0000","last_became_peered":"2024-04-26T22:21:22.404406+0000","last_unstale":"2024-04-26T22:21:23.409320+0000","last_undegraded":"2024-04-26T22:21:23.409320+0000","last_fullsized":"2024-04-26T22:21:23.409320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409406+0000","last_change":"2024-04-26T22:21:21.390689+0000","last_active":"2024-04-26T22:21:23.409406+0000","last_peered":"2024-04-26T22:21:23.409406+0000","last_clean":"2024-04-26T22:21:23.409406+0000","last_became_active":"2024-04-26T22:21:21.390404+0000","last_became_peered":"2024-04-26T22:21:21.390404+0000","last_unstale":"2024-04-26T22:21:23.409406+0000","last_undegraded":"2024-04-26T22:21:23.409406+0000","last_fullsized":"2024-04-26T22:21:23.409406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411791+0000","last_change":"2024-04-26T22:21:22.407190+0000","last_active":"2024-04-26T22:21:22.411791+0000","last_peered":"2024-04-26T22:21:22.411791+0000","last_clean":"2024-04-26T22:21:22.411791+0000","last_became_active":"2024-04-26T22:21:22.406951+0000","last_became_peered":"2024-04-26T22:21:22.406951+0000","last_unstale":"2024-04-26T22:21:22.411791+0000","last_undegraded":"2024-04-26T22:21:22.411791+0000","last_fullsized":"2024-04-26T22:21:22.411791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.433465+0000","last_change":"2024-04-26T22:21:21.392411+0000","last_active":"2024-04-26T22:21:22.433465+0000","last_peered":"2024-04-26T22:21:22.433465+0000","last_clean":"2024-04-26T22:21:22.433465+0000","last_became_active":"2024-04-26T22:21:21.392091+0000","last_became_peered":"2024-04-26T22:21:21.392091+0000","last_unstale":"2024-04-26T22:21:22.433465+0000","last_undegraded":"2024-04-26T22:21:22.433465+0000","last_fullsized":"2024-04-26T22:21:22.433465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:39.738654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423164+0000","last_change":"2024-04-26T22:21:22.415923+0000","last_active":"2024-04-26T22:21:22.423164+0000","last_peered":"2024-04-26T22:21:22.423164+0000","last_clean":"2024-04-26T22:21:22.423164+0000","last_became_active":"2024-04-26T22:21:22.415523+0000","last_became_peered":"2024-04-26T22:21:22.415523+0000","last_unstale":"2024-04-26T22:21:22.423164+0000","last_undegraded":"2024-04-26T22:21:22.423164+0000","last_fullsized":"2024-04-26T22:21:22.423164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:58.310966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395597+0000","last_change":"2024-04-26T22:21:21.397039+0000","last_active":"2024-04-26T22:21:22.395597+0000","last_peered":"2024-04-26T22:21:22.395597+0000","last_clean":"2024-04-26T22:21:22.395597+0000","last_became_active":"2024-04-26T22:21:21.395448+0000","last_became_peered":"2024-04-26T22:21:21.395448+0000","last_unstale":"2024-04-26T22:21:22.395597+0000","last_undegraded":"2024-04-26T22:21:22.395597+0000","last_fullsized":"2024-04-26T22:21:22.395597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.413049+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:22.413049+0000","last_peered":"2024-04-26T22:21:22.413049+0000","last_clean":"2024-04-26T22:21:22.413049+0000","last_became_active":"2024-04-26T22:21:22.406210+0000","last_became_peered":"2024-04-26T22:21:22.406210+0000","last_unstale":"2024-04-26T22:21:22.413049+0000","last_undegraded":"2024-04-26T22:21:22.413049+0000","last_fullsized":"2024-04-26T22:21:22.413049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408048+0000","last_change":"2024-04-26T22:21:21.395875+0000","last_active":"2024-04-26T22:21:23.408048+0000","last_peered":"2024-04-26T22:21:23.408048+0000","last_clean":"2024-04-26T22:21:23.408048+0000","last_became_active":"2024-04-26T22:21:21.395537+0000","last_became_peered":"2024-04-26T22:21:21.395537+0000","last_unstale":"2024-04-26T22:21:23.408048+0000","last_undegraded":"2024-04-26T22:21:23.408048+0000","last_fullsized":"2024-04-26T22:21:23.408048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409338+0000","last_change":"2024-04-26T22:21:22.401767+0000","last_active":"2024-04-26T22:21:23.409338+0000","last_peered":"2024-04-26T22:21:23.409338+0000","last_clean":"2024-04-26T22:21:23.409338+0000","last_became_active":"2024-04-26T22:21:22.401447+0000","last_became_peered":"2024-04-26T22:21:22.401447+0000","last_unstale":"2024-04-26T22:21:23.409338+0000","last_undegraded":"2024-04-26T22:21:23.409338+0000","last_fullsized":"2024-04-26T22:21:23.409338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.407992+0000","last_change":"2024-04-26T22:21:21.403885+0000","last_active":"2024-04-26T22:21:23.407992+0000","last_peered":"2024-04-26T22:21:23.407992+0000","last_clean":"2024-04-26T22:21:23.407992+0000","last_became_active":"2024-04-26T22:21:21.403438+0000","last_became_peered":"2024-04-26T22:21:21.403438+0000","last_unstale":"2024-04-26T22:21:23.407992+0000","last_undegraded":"2024-04-26T22:21:23.407992+0000","last_fullsized":"2024-04-26T22:21:23.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.412597+0000","last_change":"2024-04-26T22:21:22.411158+0000","last_active":"2024-04-26T22:21:22.412597+0000","last_peered":"2024-04-26T22:21:22.412597+0000","last_clean":"2024-04-26T22:21:22.412597+0000","last_became_active":"2024-04-26T22:21:22.410853+0000","last_became_peered":"2024-04-26T22:21:22.410853+0000","last_unstale":"2024-04-26T22:21:22.412597+0000","last_undegraded":"2024-04-26T22:21:22.412597+0000","last_fullsized":"2024-04-26T22:21:22.412597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408979+0000","last_change":"2024-04-26T22:21:21.392442+0000","last_active":"2024-04-26T22:21:23.408979+0000","last_peered":"2024-04-26T22:21:23.408979+0000","last_clean":"2024-04-26T22:21:23.408979+0000","last_became_active":"2024-04-26T22:21:21.389407+0000","last_became_peered":"2024-04-26T22:21:21.389407+0000","last_unstale":"2024-04-26T22:21:23.408979+0000","last_undegraded":"2024-04-26T22:21:23.408979+0000","last_fullsized":"2024-04-26T22:21:23.408979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.950669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410209+0000","last_change":"2024-04-26T22:21:22.406366+0000","last_active":"2024-04-26T22:21:22.410209+0000","last_peered":"2024-04-26T22:21:22.410209+0000","last_clean":"2024-04-26T22:21:22.410209+0000","last_became_active":"2024-04-26T22:21:22.406094+0000","last_became_peered":"2024-04-26T22:21:22.406094+0000","last_unstale":"2024-04-26T22:21:22.410209+0000","last_undegraded":"2024-04-26T22:21:22.410209+0000","last_fullsized":"2024-04-26T22:21:22.410209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408162+0000","last_change":"2024-04-26T22:21:21.396566+0000","last_active":"2024-04-26T22:21:23.408162+0000","last_peered":"2024-04-26T22:21:23.408162+0000","last_clean":"2024-04-26T22:21:23.408162+0000","last_became_active":"2024-04-26T22:21:21.396207+0000","last_became_peered":"2024-04-26T22:21:21.396207+0000","last_unstale":"2024-04-26T22:21:23.408162+0000","last_undegraded":"2024-04-26T22:21:23.408162+0000","last_fullsized":"2024-04-26T22:21:23.408162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410172+0000","last_change":"2024-04-26T22:21:22.405977+0000","last_active":"2024-04-26T22:21:22.410172+0000","last_peered":"2024-04-26T22:21:22.410172+0000","last_clean":"2024-04-26T22:21:22.410172+0000","last_became_active":"2024-04-26T22:21:22.405645+0000","last_became_peered":"2024-04-26T22:21:22.405645+0000","last_unstale":"2024-04-26T22:21:22.410172+0000","last_undegraded":"2024-04-26T22:21:22.410172+0000","last_fullsized":"2024-04-26T22:21:22.410172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412572+0000","last_change":"2024-04-26T22:21:21.405545+0000","last_active":"2024-04-26T22:21:23.412572+0000","last_peered":"2024-04-26T22:21:23.412572+0000","last_clean":"2024-04-26T22:21:23.412572+0000","last_became_active":"2024-04-26T22:21:21.403284+0000","last_became_peered":"2024-04-26T22:21:21.403284+0000","last_unstale":"2024-04-26T22:21:23.412572+0000","last_undegraded":"2024-04-26T22:21:23.412572+0000","last_fullsized":"2024-04-26T22:21:23.412572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425547+0000","last_change":"2024-04-26T22:21:22.415709+0000","last_active":"2024-04-26T22:21:22.425547+0000","last_peered":"2024-04-26T22:21:22.425547+0000","last_clean":"2024-04-26T22:21:22.425547+0000","last_became_active":"2024-04-26T22:21:22.414839+0000","last_became_peered":"2024-04-26T22:21:22.414839+0000","last_unstale":"2024-04-26T22:21:22.425547+0000","last_undegraded":"2024-04-26T22:21:22.425547+0000","last_fullsized":"2024-04-26T22:21:22.425547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408107+0000","last_change":"2024-04-26T22:21:21.397699+0000","last_active":"2024-04-26T22:21:23.408107+0000","last_peered":"2024-04-26T22:21:23.408107+0000","last_clean":"2024-04-26T22:21:23.408107+0000","last_became_active":"2024-04-26T22:21:21.397372+0000","last_became_peered":"2024-04-26T22:21:21.397372+0000","last_unstale":"2024-04-26T22:21:23.408107+0000","last_undegraded":"2024-04-26T22:21:23.408107+0000","last_fullsized":"2024-04-26T22:21:23.408107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.422300+0000","last_change":"2024-04-26T22:21:22.420982+0000","last_active":"2024-04-26T22:21:22.422300+0000","last_peered":"2024-04-26T22:21:22.422300+0000","last_clean":"2024-04-26T22:21:22.422300+0000","last_became_active":"2024-04-26T22:21:22.420729+0000","last_became_peered":"2024-04-26T22:21:22.420729+0000","last_unstale":"2024-04-26T22:21:22.422300+0000","last_undegraded":"2024-04-26T22:21:22.422300+0000","last_fullsized":"2024-04-26T22:21:22.422300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.390444+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:21:22.390444+0000","last_peered":"2024-04-26T22:21:22.390444+0000","last_clean":"2024-04-26T22:21:22.390444+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:21:22.390444+0000","last_undegraded":"2024-04-26T22:21:22.390444+0000","last_fullsized":"2024-04-26T22:21:22.390444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.392857+0000","last_change":"2024-04-26T22:21:21.400430+0000","last_active":"2024-04-26T22:21:22.392857+0000","last_peered":"2024-04-26T22:21:22.392857+0000","last_clean":"2024-04-26T22:21:22.392857+0000","last_became_active":"2024-04-26T22:21:21.400160+0000","last_became_peered":"2024-04-26T22:21:21.400160+0000","last_unstale":"2024-04-26T22:21:22.392857+0000","last_undegraded":"2024-04-26T22:21:22.392857+0000","last_fullsized":"2024-04-26T22:21:22.392857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431573+0000","last_change":"2024-04-26T22:21:22.427326+0000","last_active":"2024-04-26T22:21:22.431573+0000","last_peered":"2024-04-26T22:21:22.431573+0000","last_clean":"2024-04-26T22:21:22.431573+0000","last_became_active":"2024-04-26T22:21:22.427067+0000","last_became_peered":"2024-04-26T22:21:22.427067+0000","last_unstale":"2024-04-26T22:21:22.431573+0000","last_undegraded":"2024-04-26T22:21:22.431573+0000","last_fullsized":"2024-04-26T22:21:22.431573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:39.508019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.394067+0000","last_change":"2024-04-26T22:21:21.407696+0000","last_active":"2024-04-26T22:21:22.394067+0000","last_peered":"2024-04-26T22:21:22.394067+0000","last_clean":"2024-04-26T22:21:22.394067+0000","last_became_active":"2024-04-26T22:21:21.406397+0000","last_became_peered":"2024-04-26T22:21:21.406397+0000","last_unstale":"2024-04-26T22:21:22.394067+0000","last_undegraded":"2024-04-26T22:21:22.394067+0000","last_fullsized":"2024-04-26T22:21:22.394067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:07.497430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423017+0000","last_change":"2024-04-26T22:21:22.413618+0000","last_active":"2024-04-26T22:21:22.423017+0000","last_peered":"2024-04-26T22:21:22.423017+0000","last_clean":"2024-04-26T22:21:22.423017+0000","last_became_active":"2024-04-26T22:21:22.413285+0000","last_became_peered":"2024-04-26T22:21:22.413285+0000","last_unstale":"2024-04-26T22:21:22.423017+0000","last_undegraded":"2024-04-26T22:21:22.423017+0000","last_fullsized":"2024-04-26T22:21:22.423017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:26.127151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408143+0000","last_change":"2024-04-26T22:21:21.392079+0000","last_active":"2024-04-26T22:21:23.408143+0000","last_peered":"2024-04-26T22:21:23.408143+0000","last_clean":"2024-04-26T22:21:23.408143+0000","last_became_active":"2024-04-26T22:21:21.391760+0000","last_became_peered":"2024-04-26T22:21:21.391760+0000","last_unstale":"2024-04-26T22:21:23.408143+0000","last_undegraded":"2024-04-26T22:21:23.408143+0000","last_fullsized":"2024-04-26T22:21:23.408143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412645+0000","last_change":"2024-04-26T22:21:22.392865+0000","last_active":"2024-04-26T22:21:23.412645+0000","last_peered":"2024-04-26T22:21:23.412645+0000","last_clean":"2024-04-26T22:21:23.412645+0000","last_became_active":"2024-04-26T22:21:22.392571+0000","last_became_peered":"2024-04-26T22:21:22.392571+0000","last_unstale":"2024-04-26T22:21:23.412645+0000","last_undegraded":"2024-04-26T22:21:23.412645+0000","last_fullsized":"2024-04-26T22:21:23.412645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395602+0000","last_change":"2024-04-26T22:21:21.402750+0000","last_active":"2024-04-26T22:21:22.395602+0000","last_peered":"2024-04-26T22:21:22.395602+0000","last_clean":"2024-04-26T22:21:22.395602+0000","last_became_active":"2024-04-26T22:21:21.402348+0000","last_became_peered":"2024-04-26T22:21:21.402348+0000","last_unstale":"2024-04-26T22:21:22.395602+0000","last_undegraded":"2024-04-26T22:21:22.395602+0000","last_fullsized":"2024-04-26T22:21:22.395602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409547+0000","last_change":"2024-04-26T22:21:22.418638+0000","last_active":"2024-04-26T22:21:23.409547+0000","last_peered":"2024-04-26T22:21:23.409547+0000","last_clean":"2024-04-26T22:21:23.409547+0000","last_became_active":"2024-04-26T22:21:22.418047+0000","last_became_peered":"2024-04-26T22:21:22.418047+0000","last_unstale":"2024-04-26T22:21:23.409547+0000","last_undegraded":"2024-04-26T22:21:23.409547+0000","last_fullsized":"2024-04-26T22:21:23.409547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412552+0000","last_change":"2024-04-26T22:21:21.404376+0000","last_active":"2024-04-26T22:21:23.412552+0000","last_peered":"2024-04-26T22:21:23.412552+0000","last_clean":"2024-04-26T22:21:23.412552+0000","last_became_active":"2024-04-26T22:21:21.404115+0000","last_became_peered":"2024-04-26T22:21:21.404115+0000","last_unstale":"2024-04-26T22:21:23.412552+0000","last_undegraded":"2024-04-26T22:21:23.412552+0000","last_fullsized":"2024-04-26T22:21:23.412552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425690+0000","last_change":"2024-04-26T22:21:22.419797+0000","last_active":"2024-04-26T22:21:22.425690+0000","last_peered":"2024-04-26T22:21:22.425690+0000","last_clean":"2024-04-26T22:21:22.425690+0000","last_became_active":"2024-04-26T22:21:22.414517+0000","last_became_peered":"2024-04-26T22:21:22.414517+0000","last_unstale":"2024-04-26T22:21:22.425690+0000","last_undegraded":"2024-04-26T22:21:22.425690+0000","last_fullsized":"2024-04-26T22:21:22.425690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.391770+0000","last_change":"2024-04-26T22:21:21.405504+0000","last_active":"2024-04-26T22:21:22.391770+0000","last_peered":"2024-04-26T22:21:22.391770+0000","last_clean":"2024-04-26T22:21:22.391770+0000","last_became_active":"2024-04-26T22:21:21.405051+0000","last_became_peered":"2024-04-26T22:21:21.405051+0000","last_unstale":"2024-04-26T22:21:22.391770+0000","last_undegraded":"2024-04-26T22:21:22.391770+0000","last_fullsized":"2024-04-26T22:21:22.391770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:21.339836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412393+0000","last_change":"2024-04-26T22:21:22.392844+0000","last_active":"2024-04-26T22:21:23.412393+0000","last_peered":"2024-04-26T22:21:23.412393+0000","last_clean":"2024-04-26T22:21:23.412393+0000","last_became_active":"2024-04-26T22:21:22.392544+0000","last_became_peered":"2024-04-26T22:21:22.392544+0000","last_unstale":"2024-04-26T22:21:23.412393+0000","last_undegraded":"2024-04-26T22:21:23.412393+0000","last_fullsized":"2024-04-26T22:21:23.412393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.414226+0000","last_change":"2024-04-26T22:21:21.402324+0000","last_active":"2024-04-26T22:21:23.414226+0000","last_peered":"2024-04-26T22:21:23.414226+0000","last_clean":"2024-04-26T22:21:23.414226+0000","last_became_active":"2024-04-26T22:21:21.402029+0000","last_became_peered":"2024-04-26T22:21:21.402029+0000","last_unstale":"2024-04-26T22:21:23.414226+0000","last_undegraded":"2024-04-26T22:21:23.414226+0000","last_fullsized":"2024-04-26T22:21:23.414226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.432544+0000","last_change":"2024-04-26T22:21:22.429036+0000","last_active":"2024-04-26T22:21:22.432544+0000","last_peered":"2024-04-26T22:21:22.432544+0000","last_clean":"2024-04-26T22:21:22.432544+0000","last_became_active":"2024-04-26T22:21:22.417035+0000","last_became_peered":"2024-04-26T22:21:22.417035+0000","last_unstale":"2024-04-26T22:21:22.432544+0000","last_undegraded":"2024-04-26T22:21:22.432544+0000","last_fullsized":"2024-04-26T22:21:22.432544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:08.502863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408971+0000","last_change":"2024-04-26T22:21:21.396691+0000","last_active":"2024-04-26T22:21:23.408971+0000","last_peered":"2024-04-26T22:21:23.408971+0000","last_clean":"2024-04-26T22:21:23.408971+0000","last_became_active":"2024-04-26T22:21:21.395935+0000","last_became_peered":"2024-04-26T22:21:21.395935+0000","last_unstale":"2024-04-26T22:21:23.408971+0000","last_undegraded":"2024-04-26T22:21:23.408971+0000","last_fullsized":"2024-04-26T22:21:23.408971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423275+0000","last_change":"2024-04-26T22:21:22.418914+0000","last_active":"2024-04-26T22:21:22.423275+0000","last_peered":"2024-04-26T22:21:22.423275+0000","last_clean":"2024-04-26T22:21:22.423275+0000","last_became_active":"2024-04-26T22:21:22.418549+0000","last_became_peered":"2024-04-26T22:21:22.418549+0000","last_unstale":"2024-04-26T22:21:22.423275+0000","last_undegraded":"2024-04-26T22:21:22.423275+0000","last_fullsized":"2024-04-26T22:21:22.423275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:31.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.390383+0000","last_change":"2024-04-26T22:21:21.406456+0000","last_active":"2024-04-26T22:21:22.390383+0000","last_peered":"2024-04-26T22:21:22.390383+0000","last_clean":"2024-04-26T22:21:22.390383+0000","last_became_active":"2024-04-26T22:21:21.406032+0000","last_became_peered":"2024-04-26T22:21:21.406032+0000","last_unstale":"2024-04-26T22:21:22.390383+0000","last_undegraded":"2024-04-26T22:21:22.390383+0000","last_fullsized":"2024-04-26T22:21:22.390383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408998+0000","last_change":"2024-04-26T22:21:22.394656+0000","last_active":"2024-04-26T22:21:23.408998+0000","last_peered":"2024-04-26T22:21:23.408998+0000","last_clean":"2024-04-26T22:21:23.408998+0000","last_became_active":"2024-04-26T22:21:22.394308+0000","last_became_peered":"2024-04-26T22:21:22.394308+0000","last_unstale":"2024-04-26T22:21:23.408998+0000","last_undegraded":"2024-04-26T22:21:23.408998+0000","last_fullsized":"2024-04-26T22:21:23.408998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412559+0000","last_change":"2024-04-26T22:21:21.410610+0000","last_active":"2024-04-26T22:21:23.412559+0000","last_peered":"2024-04-26T22:21:23.412559+0000","last_clean":"2024-04-26T22:21:23.412559+0000","last_became_active":"2024-04-26T22:21:21.410307+0000","last_became_peered":"2024-04-26T22:21:21.410307+0000","last_unstale":"2024-04-26T22:21:23.412559+0000","last_undegraded":"2024-04-26T22:21:23.412559+0000","last_fullsized":"2024-04-26T22:21:23.412559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425974+0000","last_change":"2024-04-26T22:21:22.403920+0000","last_active":"2024-04-26T22:21:22.425974+0000","last_peered":"2024-04-26T22:21:22.425974+0000","last_clean":"2024-04-26T22:21:22.425974+0000","last_became_active":"2024-04-26T22:21:22.403666+0000","last_became_peered":"2024-04-26T22:21:22.403666+0000","last_unstale":"2024-04-26T22:21:22.425974+0000","last_undegraded":"2024-04-26T22:21:22.425974+0000","last_fullsized":"2024-04-26T22:21:22.425974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412507+0000","last_change":"2024-04-26T22:21:21.402151+0000","last_active":"2024-04-26T22:21:23.412507+0000","last_peered":"2024-04-26T22:21:23.412507+0000","last_clean":"2024-04-26T22:21:23.412507+0000","last_became_active":"2024-04-26T22:21:21.401806+0000","last_became_peered":"2024-04-26T22:21:21.401806+0000","last_unstale":"2024-04-26T22:21:23.412507+0000","last_undegraded":"2024-04-26T22:21:23.412507+0000","last_fullsized":"2024-04-26T22:21:23.412507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.432611+0000","last_change":"2024-04-26T22:21:22.429169+0000","last_active":"2024-04-26T22:21:22.432611+0000","last_peered":"2024-04-26T22:21:22.432611+0000","last_clean":"2024-04-26T22:21:22.432611+0000","last_became_active":"2024-04-26T22:21:22.428796+0000","last_became_peered":"2024-04-26T22:21:22.428796+0000","last_unstale":"2024-04-26T22:21:22.432611+0000","last_undegraded":"2024-04-26T22:21:22.432611+0000","last_fullsized":"2024-04-26T22:21:22.432611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424814+0000","last_change":"2024-04-26T22:21:21.408709+0000","last_active":"2024-04-26T22:21:22.424814+0000","last_peered":"2024-04-26T22:21:22.424814+0000","last_clean":"2024-04-26T22:21:22.424814+0000","last_became_active":"2024-04-26T22:21:21.408242+0000","last_became_peered":"2024-04-26T22:21:21.408242+0000","last_unstale":"2024-04-26T22:21:22.424814+0000","last_undegraded":"2024-04-26T22:21:22.424814+0000","last_fullsized":"2024-04-26T22:21:22.424814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:38.502586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408033+0000","last_change":"2024-04-26T22:21:22.406897+0000","last_active":"2024-04-26T22:21:23.408033+0000","last_peered":"2024-04-26T22:21:23.408033+0000","last_clean":"2024-04-26T22:21:23.408033+0000","last_became_active":"2024-04-26T22:21:22.406614+0000","last_became_peered":"2024-04-26T22:21:22.406614+0000","last_unstale":"2024-04-26T22:21:23.408033+0000","last_undegraded":"2024-04-26T22:21:23.408033+0000","last_fullsized":"2024-04-26T22:21:23.408033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425625+0000","last_change":"2024-04-26T22:21:22.404257+0000","last_active":"2024-04-26T22:21:22.425625+0000","last_peered":"2024-04-26T22:21:22.425625+0000","last_clean":"2024-04-26T22:21:22.425625+0000","last_became_active":"2024-04-26T22:21:22.403954+0000","last_became_peered":"2024-04-26T22:21:22.403954+0000","last_unstale":"2024-04-26T22:21:22.425625+0000","last_undegraded":"2024-04-26T22:21:22.425625+0000","last_fullsized":"2024-04-26T22:21:22.425625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426042+0000","last_change":"2024-04-26T22:21:21.406486+0000","last_active":"2024-04-26T22:21:22.426042+0000","last_peered":"2024-04-26T22:21:22.426042+0000","last_clean":"2024-04-26T22:21:22.426042+0000","last_became_active":"2024-04-26T22:21:21.406190+0000","last_became_peered":"2024-04-26T22:21:21.406190+0000","last_unstale":"2024-04-26T22:21:22.426042+0000","last_undegraded":"2024-04-26T22:21:22.426042+0000","last_fullsized":"2024-04-26T22:21:22.426042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:45.631147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425571+0000","last_change":"2024-04-26T22:21:22.415974+0000","last_active":"2024-04-26T22:21:22.425571+0000","last_peered":"2024-04-26T22:21:22.425571+0000","last_clean":"2024-04-26T22:21:22.425571+0000","last_became_active":"2024-04-26T22:21:22.415384+0000","last_became_peered":"2024-04-26T22:21:22.415384+0000","last_unstale":"2024-04-26T22:21:22.425571+0000","last_undegraded":"2024-04-26T22:21:22.425571+0000","last_fullsized":"2024-04-26T22:21:22.425571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426483+0000","last_change":"2024-04-26T22:21:21.405267+0000","last_active":"2024-04-26T22:21:22.426483+0000","last_peered":"2024-04-26T22:21:22.426483+0000","last_clean":"2024-04-26T22:21:22.426483+0000","last_became_active":"2024-04-26T22:21:21.404669+0000","last_became_peered":"2024-04-26T22:21:21.404669+0000","last_unstale":"2024-04-26T22:21:22.426483+0000","last_undegraded":"2024-04-26T22:21:22.426483+0000","last_fullsized":"2024-04-26T22:21:22.426483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424113+0000","last_change":"2024-04-26T22:21:22.422015+0000","last_active":"2024-04-26T22:21:22.424113+0000","last_peered":"2024-04-26T22:21:22.424113+0000","last_clean":"2024-04-26T22:21:22.424113+0000","last_became_active":"2024-04-26T22:21:22.421713+0000","last_became_peered":"2024-04-26T22:21:22.421713+0000","last_unstale":"2024-04-26T22:21:22.424113+0000","last_undegraded":"2024-04-26T22:21:22.424113+0000","last_fullsized":"2024-04-26T22:21:22.424113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:26.799919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.429001+0000","last_change":"2024-04-26T22:21:21.396531+0000","last_active":"2024-04-26T22:21:22.429001+0000","last_peered":"2024-04-26T22:21:22.429001+0000","last_clean":"2024-04-26T22:21:22.429001+0000","last_became_active":"2024-04-26T22:21:21.395948+0000","last_became_peered":"2024-04-26T22:21:21.395948+0000","last_unstale":"2024-04-26T22:21:22.429001+0000","last_undegraded":"2024-04-26T22:21:22.429001+0000","last_fullsized":"2024-04-26T22:21:22.429001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410814+0000","last_change":"2024-04-26T22:21:22.406649+0000","last_active":"2024-04-26T22:21:22.410814+0000","last_peered":"2024-04-26T22:21:22.410814+0000","last_clean":"2024-04-26T22:21:22.410814+0000","last_became_active":"2024-04-26T22:21:22.406377+0000","last_became_peered":"2024-04-26T22:21:22.406377+0000","last_unstale":"2024-04-26T22:21:22.410814+0000","last_undegraded":"2024-04-26T22:21:22.410814+0000","last_fullsized":"2024-04-26T22:21:22.410814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.433823+0000","last_change":"2024-04-26T22:21:21.401403+0000","last_active":"2024-04-26T22:21:22.433823+0000","last_peered":"2024-04-26T22:21:22.433823+0000","last_clean":"2024-04-26T22:21:22.433823+0000","last_became_active":"2024-04-26T22:21:21.401028+0000","last_became_peered":"2024-04-26T22:21:21.401028+0000","last_unstale":"2024-04-26T22:21:22.433823+0000","last_undegraded":"2024-04-26T22:21:22.433823+0000","last_fullsized":"2024-04-26T22:21:22.433823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:19.445168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":660934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":71596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":208896,"data_stored":69984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":660990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:21:26.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:21:26.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.692+0000 7f1323c00640 1 Processor -- start 2024-04-26T22:21:26.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.692+0000 7f1323c00640 1 -- start start 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1323c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f131c0a0bb0 0x7f131c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1323c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c1489c0 0x7f131c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1323c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131c0700f0 con 0x7f131c0a07d0 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1323c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f131c070420 con 0x7f131c0a0bb0 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1323c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f131c149330 con 0x7f131c1489c0 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f131c0a0bb0 0x7f131c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f131c0a0bb0 0x7f131c0708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41494/0 (socket says 172.21.15.16:41494) 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1321200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f131c0a07d0 0x7f131c073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59408/0 (socket says 172.21.15.16:59408) 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 -- 172.21.15.16:0/3323548576 learned_addr learned my addr 172.21.15.16:0/3323548576 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f1321c00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c1489c0 0x7f131c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 -- 172.21.15.16:0/3323548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c1489c0 msgr2=0x7f131c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c1489c0 0x7f131c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 -- 172.21.15.16:0/3323548576 >> v1:172.21.15.16:6789/0 conn(0x7f131c0a07d0 legacy=0x7f131c073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.696+0000 7f131be00640 1 -- 172.21.15.16:0/3323548576 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c071140 con 0x7f131c0a0bb0 2024-04-26T22:21:26.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f131be00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c0a0bb0 0x7f131c0708b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1308009870 tx=0x7f130801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535dc5ff956e5677 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f131b400640 1 -- 172.21.15.16:0/3323548576 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13080aa650 con 0x7f131c0a0bb0 2024-04-26T22:21:26.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f131b400640 1 -- 172.21.15.16:0/3323548576 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13080af070 con 0x7f131c0a0bb0 2024-04-26T22:21:26.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f131b400640 1 -- 172.21.15.16:0/3323548576 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13080aaa10 con 0x7f131c0a0bb0 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- 172.21.15.16:0/3323548576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c0a0bb0 msgr2=0x7f131c0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c0a0bb0 0x7f131c0708b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1308009870 tx=0x7f130801c4d0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- 172.21.15.16:0/3323548576 shutdown_connections 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c1489c0 0x7f131c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- 172.21.15.16:0/3323548576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c0a0bb0 0x7f131c0708b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- 172.21.15.16:0/3323548576 >> 172.21.15.16:0/3323548576 conn(0x7f131c0b87c0 msgr2=0x7f131c0b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- 172.21.15.16:0/3323548576 shutdown_connections 2024-04-26T22:21:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- 172.21.15.16:0/3323548576 wait complete. 2024-04-26T22:21:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 Processor -- start 2024-04-26T22:21:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- start start 2024-04-26T22:21:26.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 0x7f131c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 0x7f131c1e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f131c155f10 con 0x7f131c1489c0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f131c155d90 con 0x7f131c0a07d0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.700+0000 7f1323c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f131c156090 con 0x7f131c0a0bb0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41500/0 (socket says 172.21.15.16:41500) 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 -- 172.21.15.16:0/2765240256 learned_addr learned my addr 172.21.15.16:0/2765240256 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321200640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 0x7f131c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f131be00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 0x7f131c1e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 -- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 msgr2=0x7f131c1e1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 0x7f131c1e1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 -- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 msgr2=0x7f131c147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 0x7f131c147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 -- 172.21.15.16:0/2765240256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c143850 con 0x7f131c1489c0 2024-04-26T22:21:26.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f131be00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 0x7f131c1e1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321200640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 0x7f131c147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1321c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1314007e40 tx=0x7f131400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314014620 con 0x7f131c1489c0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1314019070 con 0x7f131c1489c0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1e1510 con 0x7f131c1489c0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314014a20 con 0x7f131c1489c0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c0b5f70 con 0x7f131c1489c0 2024-04-26T22:21:26.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c0b6330 con 0x7f131c1489c0 2024-04-26T22:21:26.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1314014bc0 con 0x7f131c1489c0 2024-04-26T22:21:26.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.704+0000 7f1318c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 0x7f12fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:26.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.708+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f13140872b0 con 0x7f131c1489c0 2024-04-26T22:21:26.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.708+0000 7f1321200640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 0x7f12fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:26.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.708+0000 7f1321200640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 0x7f12fc06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1310000f70 tx=0x7f1310007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:26.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.712+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1314057860 con 0x7f131c1489c0 2024-04-26T22:21:26.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.872+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f131c069530 con 0x7f12fc068380 2024-04-26T22:21:26.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.880+0000 7f1318c00640 1 -- 172.21.15.16:0/2765240256 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251897 (secure 0 0 0) 0x7f131c069530 con 0x7f12fc068380 2024-04-26T22:21:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:26.884 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:21:26.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 msgr2=0x7f12fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 0x7f12fc06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1310000f70 tx=0x7f1310007d70 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 msgr2=0x7f131c1e1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1314007e40 tx=0x7f131400e4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 shutdown_connections 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f12fc068380 0x7f12fc06a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f131c1489c0 0x7f131c1e1f70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f131c0a0bb0 0x7f131c1e1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 --2- 172.21.15.16:0/2765240256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f131c0a07d0 0x7f131c147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 >> 172.21.15.16:0/2765240256 conn(0x7f131c0b87c0 msgr2=0x7f131c073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 shutdown_connections 2024-04-26T22:21:26.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:26.884+0000 7f1323c00640 1 -- 172.21.15.16:0/2765240256 wait complete. 2024-04-26T22:21:26.903 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T22:21:26.101839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248156,"kb_used_data":2880,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726564,"statfs":{"total":773094113280,"available":772840001536,"internally_reserved":0,"allocated":2949120,"data_stored":1758028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.731969"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411829+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:22.411829+0000","last_peered":"2024-04-26T22:21:22.411829+0000","last_clean":"2024-04-26T22:21:22.411829+0000","last_became_active":"2024-04-26T22:21:22.404969+0000","last_became_peered":"2024-04-26T22:21:22.404969+0000","last_unstale":"2024-04-26T22:21:22.411829+0000","last_undegraded":"2024-04-26T22:21:22.411829+0000","last_fullsized":"2024-04-26T22:21:22.411829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412521+0000","last_change":"2024-04-26T22:21:22.419853+0000","last_active":"2024-04-26T22:21:23.412521+0000","last_peered":"2024-04-26T22:21:23.412521+0000","last_clean":"2024-04-26T22:21:23.412521+0000","last_became_active":"2024-04-26T22:21:22.419507+0000","last_became_peered":"2024-04-26T22:21:22.419507+0000","last_unstale":"2024-04-26T22:21:23.412521+0000","last_undegraded":"2024-04-26T22:21:23.412521+0000","last_fullsized":"2024-04-26T22:21:23.412521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.417849+0000","last_change":"2024-04-26T22:21:22.402773+0000","last_active":"2024-04-26T22:21:22.417849+0000","last_peered":"2024-04-26T22:21:22.417849+0000","last_clean":"2024-04-26T22:21:22.417849+0000","last_became_active":"2024-04-26T22:21:22.402398+0000","last_became_peered":"2024-04-26T22:21:22.402398+0000","last_unstale":"2024-04-26T22:21:22.417849+0000","last_undegraded":"2024-04-26T22:21:22.417849+0000","last_fullsized":"2024-04-26T22:21:22.417849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:16.130596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425659+0000","last_change":"2024-04-26T22:21:22.419823+0000","last_active":"2024-04-26T22:21:22.425659+0000","last_peered":"2024-04-26T22:21:22.425659+0000","last_clean":"2024-04-26T22:21:22.425659+0000","last_became_active":"2024-04-26T22:21:22.419566+0000","last_became_peered":"2024-04-26T22:21:22.419566+0000","last_unstale":"2024-04-26T22:21:22.425659+0000","last_undegraded":"2024-04-26T22:21:22.425659+0000","last_fullsized":"2024-04-26T22:21:22.425659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410446+0000","last_change":"2024-04-26T22:21:22.406403+0000","last_active":"2024-04-26T22:21:22.410446+0000","last_peered":"2024-04-26T22:21:22.410446+0000","last_clean":"2024-04-26T22:21:22.410446+0000","last_became_active":"2024-04-26T22:21:22.406043+0000","last_became_peered":"2024-04-26T22:21:22.406043+0000","last_unstale":"2024-04-26T22:21:22.410446+0000","last_undegraded":"2024-04-26T22:21:22.410446+0000","last_fullsized":"2024-04-26T22:21:22.410446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426178+0000","last_change":"2024-04-26T22:21:22.414425+0000","last_active":"2024-04-26T22:21:22.426178+0000","last_peered":"2024-04-26T22:21:22.426178+0000","last_clean":"2024-04-26T22:21:22.426178+0000","last_became_active":"2024-04-26T22:21:22.414091+0000","last_became_peered":"2024-04-26T22:21:22.414091+0000","last_unstale":"2024-04-26T22:21:22.426178+0000","last_undegraded":"2024-04-26T22:21:22.426178+0000","last_fullsized":"2024-04-26T22:21:22.426178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:46.636579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.419517+0000","last_change":"2024-04-26T22:21:22.416374+0000","last_active":"2024-04-26T22:21:22.419517+0000","last_peered":"2024-04-26T22:21:22.419517+0000","last_clean":"2024-04-26T22:21:22.419517+0000","last_became_active":"2024-04-26T22:21:22.415971+0000","last_became_peered":"2024-04-26T22:21:22.415971+0000","last_unstale":"2024-04-26T22:21:22.419517+0000","last_undegraded":"2024-04-26T22:21:22.419517+0000","last_fullsized":"2024-04-26T22:21:22.419517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431283+0000","last_change":"2024-04-26T22:21:22.426064+0000","last_active":"2024-04-26T22:21:22.431283+0000","last_peered":"2024-04-26T22:21:22.431283+0000","last_clean":"2024-04-26T22:21:22.431283+0000","last_became_active":"2024-04-26T22:21:22.425772+0000","last_became_peered":"2024-04-26T22:21:22.425772+0000","last_unstale":"2024-04-26T22:21:22.431283+0000","last_undegraded":"2024-04-26T22:21:22.431283+0000","last_fullsized":"2024-04-26T22:21:22.431283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:46.636579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.421853+0000","last_change":"2024-04-26T22:21:22.419613+0000","last_active":"2024-04-26T22:21:22.421853+0000","last_peered":"2024-04-26T22:21:22.421853+0000","last_clean":"2024-04-26T22:21:22.421853+0000","last_became_active":"2024-04-26T22:21:22.419007+0000","last_became_peered":"2024-04-26T22:21:22.419007+0000","last_unstale":"2024-04-26T22:21:22.421853+0000","last_undegraded":"2024-04-26T22:21:22.421853+0000","last_fullsized":"2024-04-26T22:21:22.421853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409029+0000","last_change":"2024-04-26T22:21:22.423811+0000","last_active":"2024-04-26T22:21:23.409029+0000","last_peered":"2024-04-26T22:21:23.409029+0000","last_clean":"2024-04-26T22:21:23.409029+0000","last_became_active":"2024-04-26T22:21:22.418209+0000","last_became_peered":"2024-04-26T22:21:22.418209+0000","last_unstale":"2024-04-26T22:21:23.409029+0000","last_undegraded":"2024-04-26T22:21:23.409029+0000","last_fullsized":"2024-04-26T22:21:23.409029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408471+0000","last_change":"2024-04-26T22:21:22.417717+0000","last_active":"2024-04-26T22:21:23.408471+0000","last_peered":"2024-04-26T22:21:23.408471+0000","last_clean":"2024-04-26T22:21:23.408471+0000","last_became_active":"2024-04-26T22:21:22.417411+0000","last_became_peered":"2024-04-26T22:21:22.417411+0000","last_unstale":"2024-04-26T22:21:23.408471+0000","last_undegraded":"2024-04-26T22:21:23.408471+0000","last_fullsized":"2024-04-26T22:21:23.408471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409203+0000","last_change":"2024-04-26T22:21:22.399958+0000","last_active":"2024-04-26T22:21:23.409203+0000","last_peered":"2024-04-26T22:21:23.409203+0000","last_clean":"2024-04-26T22:21:23.409203+0000","last_became_active":"2024-04-26T22:21:22.398263+0000","last_became_peered":"2024-04-26T22:21:22.398263+0000","last_unstale":"2024-04-26T22:21:23.409203+0000","last_undegraded":"2024-04-26T22:21:23.409203+0000","last_fullsized":"2024-04-26T22:21:23.409203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.408395+0000","last_change":"2024-04-26T22:21:22.401315+0000","last_active":"2024-04-26T22:21:22.408395+0000","last_peered":"2024-04-26T22:21:22.408395+0000","last_clean":"2024-04-26T22:21:22.408395+0000","last_became_active":"2024-04-26T22:21:22.401055+0000","last_became_peered":"2024-04-26T22:21:22.401055+0000","last_unstale":"2024-04-26T22:21:22.408395+0000","last_undegraded":"2024-04-26T22:21:22.408395+0000","last_fullsized":"2024-04-26T22:21:22.408395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:59.988603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411302+0000","last_change":"2024-04-26T22:21:22.401017+0000","last_active":"2024-04-26T22:21:22.411302+0000","last_peered":"2024-04-26T22:21:22.411302+0000","last_clean":"2024-04-26T22:21:22.411302+0000","last_became_active":"2024-04-26T22:21:22.400740+0000","last_became_peered":"2024-04-26T22:21:22.400740+0000","last_unstale":"2024-04-26T22:21:22.411302+0000","last_undegraded":"2024-04-26T22:21:22.411302+0000","last_fullsized":"2024-04-26T22:21:22.411302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:39.110847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412340+0000","last_change":"2024-04-26T22:21:22.391216+0000","last_active":"2024-04-26T22:21:23.412340+0000","last_peered":"2024-04-26T22:21:23.412340+0000","last_clean":"2024-04-26T22:21:23.412340+0000","last_became_active":"2024-04-26T22:21:22.390914+0000","last_became_peered":"2024-04-26T22:21:22.390914+0000","last_unstale":"2024-04-26T22:21:23.412340+0000","last_undegraded":"2024-04-26T22:21:23.412340+0000","last_fullsized":"2024-04-26T22:21:23.412340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424838+0000","last_change":"2024-04-26T22:21:22.415179+0000","last_active":"2024-04-26T22:21:22.424838+0000","last_peered":"2024-04-26T22:21:22.424838+0000","last_clean":"2024-04-26T22:21:22.424838+0000","last_became_active":"2024-04-26T22:21:22.414894+0000","last_became_peered":"2024-04-26T22:21:22.414894+0000","last_unstale":"2024-04-26T22:21:22.424838+0000","last_undegraded":"2024-04-26T22:21:22.424838+0000","last_fullsized":"2024-04-26T22:21:22.424838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:08.502863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425474+0000","last_change":"2024-04-26T22:21:22.414418+0000","last_active":"2024-04-26T22:21:22.425474+0000","last_peered":"2024-04-26T22:21:22.425474+0000","last_clean":"2024-04-26T22:21:22.425474+0000","last_became_active":"2024-04-26T22:21:22.413203+0000","last_became_peered":"2024-04-26T22:21:22.413203+0000","last_unstale":"2024-04-26T22:21:22.425474+0000","last_undegraded":"2024-04-26T22:21:22.425474+0000","last_fullsized":"2024-04-26T22:21:22.425474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:39.508019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408121+0000","last_change":"2024-04-26T22:21:22.406821+0000","last_active":"2024-04-26T22:21:23.408121+0000","last_peered":"2024-04-26T22:21:23.408121+0000","last_clean":"2024-04-26T22:21:23.408121+0000","last_became_active":"2024-04-26T22:21:22.406613+0000","last_became_peered":"2024-04-26T22:21:22.406613+0000","last_unstale":"2024-04-26T22:21:23.408121+0000","last_undegraded":"2024-04-26T22:21:23.408121+0000","last_fullsized":"2024-04-26T22:21:23.408121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.412567+0000","last_change":"2024-04-26T22:21:22.410515+0000","last_active":"2024-04-26T22:21:22.412567+0000","last_peered":"2024-04-26T22:21:22.412567+0000","last_clean":"2024-04-26T22:21:22.412567+0000","last_became_active":"2024-04-26T22:21:22.410219+0000","last_became_peered":"2024-04-26T22:21:22.410219+0000","last_unstale":"2024-04-26T22:21:22.412567+0000","last_undegraded":"2024-04-26T22:21:22.412567+0000","last_fullsized":"2024-04-26T22:21:22.412567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409256+0000","last_change":"2024-04-26T22:21:22.407928+0000","last_active":"2024-04-26T22:21:23.409256+0000","last_peered":"2024-04-26T22:21:23.409256+0000","last_clean":"2024-04-26T22:21:23.409256+0000","last_became_active":"2024-04-26T22:21:22.407586+0000","last_became_peered":"2024-04-26T22:21:22.407586+0000","last_unstale":"2024-04-26T22:21:23.409256+0000","last_undegraded":"2024-04-26T22:21:23.409256+0000","last_fullsized":"2024-04-26T22:21:23.409256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423227+0000","last_change":"2024-04-26T22:21:22.415479+0000","last_active":"2024-04-26T22:21:22.423227+0000","last_peered":"2024-04-26T22:21:22.423227+0000","last_clean":"2024-04-26T22:21:22.423227+0000","last_became_active":"2024-04-26T22:21:22.415221+0000","last_became_peered":"2024-04-26T22:21:22.415221+0000","last_unstale":"2024-04-26T22:21:22.423227+0000","last_undegraded":"2024-04-26T22:21:22.423227+0000","last_fullsized":"2024-04-26T22:21:22.423227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:03.847233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426160+0000","last_change":"2024-04-26T22:21:22.412956+0000","last_active":"2024-04-26T22:21:22.426160+0000","last_peered":"2024-04-26T22:21:22.426160+0000","last_clean":"2024-04-26T22:21:22.426160+0000","last_became_active":"2024-04-26T22:21:22.412717+0000","last_became_peered":"2024-04-26T22:21:22.412717+0000","last_unstale":"2024-04-26T22:21:22.426160+0000","last_undegraded":"2024-04-26T22:21:22.426160+0000","last_fullsized":"2024-04-26T22:21:22.426160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:22.345268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.418241+0000","last_change":"2024-04-26T22:21:22.410307+0000","last_active":"2024-04-26T22:21:22.418241+0000","last_peered":"2024-04-26T22:21:22.418241+0000","last_clean":"2024-04-26T22:21:22.418241+0000","last_became_active":"2024-04-26T22:21:22.410111+0000","last_became_peered":"2024-04-26T22:21:22.410111+0000","last_unstale":"2024-04-26T22:21:22.418241+0000","last_undegraded":"2024-04-26T22:21:22.418241+0000","last_fullsized":"2024-04-26T22:21:22.418241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.428647+0000","last_change":"2024-04-26T22:21:22.427712+0000","last_active":"2024-04-26T22:21:22.428647+0000","last_peered":"2024-04-26T22:21:22.428647+0000","last_clean":"2024-04-26T22:21:22.428647+0000","last_became_active":"2024-04-26T22:21:22.427358+0000","last_became_peered":"2024-04-26T22:21:22.427358+0000","last_unstale":"2024-04-26T22:21:22.428647+0000","last_undegraded":"2024-04-26T22:21:22.428647+0000","last_fullsized":"2024-04-26T22:21:22.428647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.427940+0000","last_change":"2024-04-26T22:21:22.412148+0000","last_active":"2024-04-26T22:21:22.427940+0000","last_peered":"2024-04-26T22:21:22.427940+0000","last_clean":"2024-04-26T22:21:22.427940+0000","last_became_active":"2024-04-26T22:21:22.411380+0000","last_became_peered":"2024-04-26T22:21:22.411380+0000","last_unstale":"2024-04-26T22:21:22.427940+0000","last_undegraded":"2024-04-26T22:21:22.427940+0000","last_fullsized":"2024-04-26T22:21:22.427940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409175+0000","last_change":"2024-04-26T22:21:22.412872+0000","last_active":"2024-04-26T22:21:23.409175+0000","last_peered":"2024-04-26T22:21:23.409175+0000","last_clean":"2024-04-26T22:21:23.409175+0000","last_became_active":"2024-04-26T22:21:22.412429+0000","last_became_peered":"2024-04-26T22:21:22.412429+0000","last_unstale":"2024-04-26T22:21:23.409175+0000","last_undegraded":"2024-04-26T22:21:23.409175+0000","last_fullsized":"2024-04-26T22:21:23.409175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412454+0000","last_change":"2024-04-26T22:21:22.403344+0000","last_active":"2024-04-26T22:21:23.412454+0000","last_peered":"2024-04-26T22:21:23.412454+0000","last_clean":"2024-04-26T22:21:23.412454+0000","last_became_active":"2024-04-26T22:21:22.403042+0000","last_became_peered":"2024-04-26T22:21:22.403042+0000","last_unstale":"2024-04-26T22:21:23.412454+0000","last_undegraded":"2024-04-26T22:21:23.412454+0000","last_fullsized":"2024-04-26T22:21:23.412454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.418714+0000","last_change":"2024-04-26T22:21:22.411698+0000","last_active":"2024-04-26T22:21:22.418714+0000","last_peered":"2024-04-26T22:21:22.418714+0000","last_clean":"2024-04-26T22:21:22.418714+0000","last_became_active":"2024-04-26T22:21:22.410959+0000","last_became_peered":"2024-04-26T22:21:22.410959+0000","last_unstale":"2024-04-26T22:21:22.418714+0000","last_undegraded":"2024-04-26T22:21:22.418714+0000","last_fullsized":"2024-04-26T22:21:22.418714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423211+0000","last_change":"2024-04-26T22:21:22.414909+0000","last_active":"2024-04-26T22:21:22.423211+0000","last_peered":"2024-04-26T22:21:22.423211+0000","last_clean":"2024-04-26T22:21:22.423211+0000","last_became_active":"2024-04-26T22:21:22.412967+0000","last_became_peered":"2024-04-26T22:21:22.412967+0000","last_unstale":"2024-04-26T22:21:22.423211+0000","last_undegraded":"2024-04-26T22:21:22.423211+0000","last_fullsized":"2024-04-26T22:21:22.423211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:49.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426140+0000","last_change":"2024-04-26T22:21:22.412771+0000","last_active":"2024-04-26T22:21:22.426140+0000","last_peered":"2024-04-26T22:21:22.426140+0000","last_clean":"2024-04-26T22:21:22.426140+0000","last_became_active":"2024-04-26T22:21:22.412269+0000","last_became_peered":"2024-04-26T22:21:22.412269+0000","last_unstale":"2024-04-26T22:21:22.426140+0000","last_undegraded":"2024-04-26T22:21:22.426140+0000","last_fullsized":"2024-04-26T22:21:22.426140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408052+0000","last_change":"2024-04-26T22:21:22.420475+0000","last_active":"2024-04-26T22:21:23.408052+0000","last_peered":"2024-04-26T22:21:23.408052+0000","last_clean":"2024-04-26T22:21:23.408052+0000","last_became_active":"2024-04-26T22:21:22.420224+0000","last_became_peered":"2024-04-26T22:21:22.420224+0000","last_unstale":"2024-04-26T22:21:23.408052+0000","last_undegraded":"2024-04-26T22:21:23.408052+0000","last_fullsized":"2024-04-26T22:21:23.408052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408065+0000","last_change":"2024-04-26T22:21:22.417961+0000","last_active":"2024-04-26T22:21:23.408065+0000","last_peered":"2024-04-26T22:21:23.408065+0000","last_clean":"2024-04-26T22:21:23.408065+0000","last_became_active":"2024-04-26T22:21:22.417173+0000","last_became_peered":"2024-04-26T22:21:22.417173+0000","last_unstale":"2024-04-26T22:21:23.408065+0000","last_undegraded":"2024-04-26T22:21:23.408065+0000","last_fullsized":"2024-04-26T22:21:23.408065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409653+0000","last_change":"2024-04-26T22:21:22.399070+0000","last_active":"2024-04-26T22:21:23.409653+0000","last_peered":"2024-04-26T22:21:23.409653+0000","last_clean":"2024-04-26T22:21:23.409653+0000","last_became_active":"2024-04-26T22:21:22.398182+0000","last_became_peered":"2024-04-26T22:21:22.398182+0000","last_unstale":"2024-04-26T22:21:23.409653+0000","last_undegraded":"2024-04-26T22:21:23.409653+0000","last_fullsized":"2024-04-26T22:21:23.409653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.430184+0000","last_change":"2024-04-26T22:21:21.400248+0000","last_active":"2024-04-26T22:21:22.430184+0000","last_peered":"2024-04-26T22:21:22.430184+0000","last_clean":"2024-04-26T22:21:22.430184+0000","last_became_active":"2024-04-26T22:21:21.399953+0000","last_became_peered":"2024-04-26T22:21:21.399953+0000","last_unstale":"2024-04-26T22:21:22.430184+0000","last_undegraded":"2024-04-26T22:21:22.430184+0000","last_fullsized":"2024-04-26T22:21:22.430184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423190+0000","last_change":"2024-04-26T22:21:22.414633+0000","last_active":"2024-04-26T22:21:22.423190+0000","last_peered":"2024-04-26T22:21:22.423190+0000","last_clean":"2024-04-26T22:21:22.423190+0000","last_became_active":"2024-04-26T22:21:22.414387+0000","last_became_peered":"2024-04-26T22:21:22.414387+0000","last_unstale":"2024-04-26T22:21:22.423190+0000","last_undegraded":"2024-04-26T22:21:22.423190+0000","last_fullsized":"2024-04-26T22:21:22.423190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:11.015287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408260+0000","last_change":"2024-04-26T22:21:21.400875+0000","last_active":"2024-04-26T22:21:23.408260+0000","last_peered":"2024-04-26T22:21:23.408260+0000","last_clean":"2024-04-26T22:21:23.408260+0000","last_became_active":"2024-04-26T22:21:21.400561+0000","last_became_peered":"2024-04-26T22:21:21.400561+0000","last_unstale":"2024-04-26T22:21:23.408260+0000","last_undegraded":"2024-04-26T22:21:23.408260+0000","last_fullsized":"2024-04-26T22:21:23.408260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395555+0000","last_change":"2024-04-26T22:21:21.395724+0000","last_active":"2024-04-26T22:21:22.395555+0000","last_peered":"2024-04-26T22:21:22.395555+0000","last_clean":"2024-04-26T22:21:22.395555+0000","last_became_active":"2024-04-26T22:21:21.395270+0000","last_became_peered":"2024-04-26T22:21:21.395270+0000","last_unstale":"2024-04-26T22:21:22.395555+0000","last_undegraded":"2024-04-26T22:21:22.395555+0000","last_fullsized":"2024-04-26T22:21:22.395555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431257+0000","last_change":"2024-04-26T22:21:22.425600+0000","last_active":"2024-04-26T22:21:22.431257+0000","last_peered":"2024-04-26T22:21:22.431257+0000","last_clean":"2024-04-26T22:21:22.431257+0000","last_became_active":"2024-04-26T22:21:22.420621+0000","last_became_peered":"2024-04-26T22:21:22.420621+0000","last_unstale":"2024-04-26T22:21:22.431257+0000","last_undegraded":"2024-04-26T22:21:22.431257+0000","last_fullsized":"2024-04-26T22:21:22.431257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:22.345268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.404021+0000","last_change":"2024-04-26T22:21:21.396563+0000","last_active":"2024-04-26T22:21:22.404021+0000","last_peered":"2024-04-26T22:21:22.404021+0000","last_clean":"2024-04-26T22:21:22.404021+0000","last_became_active":"2024-04-26T22:21:21.393730+0000","last_became_peered":"2024-04-26T22:21:21.393730+0000","last_unstale":"2024-04-26T22:21:22.404021+0000","last_undegraded":"2024-04-26T22:21:22.404021+0000","last_fullsized":"2024-04-26T22:21:22.404021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412421+0000","last_change":"2024-04-26T22:21:22.399913+0000","last_active":"2024-04-26T22:21:23.412421+0000","last_peered":"2024-04-26T22:21:23.412421+0000","last_clean":"2024-04-26T22:21:23.412421+0000","last_became_active":"2024-04-26T22:21:22.399633+0000","last_became_peered":"2024-04-26T22:21:22.399633+0000","last_unstale":"2024-04-26T22:21:23.412421+0000","last_undegraded":"2024-04-26T22:21:23.412421+0000","last_fullsized":"2024-04-26T22:21:23.412421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408864+0000","last_change":"2024-04-26T22:21:21.401808+0000","last_active":"2024-04-26T22:21:23.408864+0000","last_peered":"2024-04-26T22:21:23.408864+0000","last_clean":"2024-04-26T22:21:23.408864+0000","last_became_active":"2024-04-26T22:21:21.401323+0000","last_became_peered":"2024-04-26T22:21:21.401323+0000","last_unstale":"2024-04-26T22:21:23.408864+0000","last_undegraded":"2024-04-26T22:21:23.408864+0000","last_fullsized":"2024-04-26T22:21:23.408864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425008+0000","last_change":"2024-04-26T22:21:22.416004+0000","last_active":"2024-04-26T22:21:22.425008+0000","last_peered":"2024-04-26T22:21:22.425008+0000","last_clean":"2024-04-26T22:21:22.425008+0000","last_became_active":"2024-04-26T22:21:22.415730+0000","last_became_peered":"2024-04-26T22:21:22.415730+0000","last_unstale":"2024-04-26T22:21:22.425008+0000","last_undegraded":"2024-04-26T22:21:22.425008+0000","last_fullsized":"2024-04-26T22:21:22.425008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.396462+0000","last_change":"2024-04-26T22:21:21.403091+0000","last_active":"2024-04-26T22:21:22.396462+0000","last_peered":"2024-04-26T22:21:22.396462+0000","last_clean":"2024-04-26T22:21:22.396462+0000","last_became_active":"2024-04-26T22:21:21.402767+0000","last_became_peered":"2024-04-26T22:21:21.402767+0000","last_unstale":"2024-04-26T22:21:22.396462+0000","last_undegraded":"2024-04-26T22:21:22.396462+0000","last_fullsized":"2024-04-26T22:21:22.396462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424088+0000","last_change":"2024-04-26T22:21:22.421952+0000","last_active":"2024-04-26T22:21:22.424088+0000","last_peered":"2024-04-26T22:21:22.424088+0000","last_clean":"2024-04-26T22:21:22.424088+0000","last_became_active":"2024-04-26T22:21:22.421689+0000","last_became_peered":"2024-04-26T22:21:22.421689+0000","last_unstale":"2024-04-26T22:21:22.424088+0000","last_undegraded":"2024-04-26T22:21:22.424088+0000","last_fullsized":"2024-04-26T22:21:22.424088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:44.987098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412426+0000","last_change":"2024-04-26T22:21:21.410257+0000","last_active":"2024-04-26T22:21:23.412426+0000","last_peered":"2024-04-26T22:21:23.412426+0000","last_clean":"2024-04-26T22:21:23.412426+0000","last_became_active":"2024-04-26T22:21:21.409894+0000","last_became_peered":"2024-04-26T22:21:21.409894+0000","last_unstale":"2024-04-26T22:21:23.412426+0000","last_undegraded":"2024-04-26T22:21:23.412426+0000","last_fullsized":"2024-04-26T22:21:23.412426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409320+0000","last_change":"2024-04-26T22:21:22.404687+0000","last_active":"2024-04-26T22:21:23.409320+0000","last_peered":"2024-04-26T22:21:23.409320+0000","last_clean":"2024-04-26T22:21:23.409320+0000","last_became_active":"2024-04-26T22:21:22.404406+0000","last_became_peered":"2024-04-26T22:21:22.404406+0000","last_unstale":"2024-04-26T22:21:23.409320+0000","last_undegraded":"2024-04-26T22:21:23.409320+0000","last_fullsized":"2024-04-26T22:21:23.409320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409406+0000","last_change":"2024-04-26T22:21:21.390689+0000","last_active":"2024-04-26T22:21:23.409406+0000","last_peered":"2024-04-26T22:21:23.409406+0000","last_clean":"2024-04-26T22:21:23.409406+0000","last_became_active":"2024-04-26T22:21:21.390404+0000","last_became_peered":"2024-04-26T22:21:21.390404+0000","last_unstale":"2024-04-26T22:21:23.409406+0000","last_undegraded":"2024-04-26T22:21:23.409406+0000","last_fullsized":"2024-04-26T22:21:23.409406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.411791+0000","last_change":"2024-04-26T22:21:22.407190+0000","last_active":"2024-04-26T22:21:22.411791+0000","last_peered":"2024-04-26T22:21:22.411791+0000","last_clean":"2024-04-26T22:21:22.411791+0000","last_became_active":"2024-04-26T22:21:22.406951+0000","last_became_peered":"2024-04-26T22:21:22.406951+0000","last_unstale":"2024-04-26T22:21:22.411791+0000","last_undegraded":"2024-04-26T22:21:22.411791+0000","last_fullsized":"2024-04-26T22:21:22.411791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.433465+0000","last_change":"2024-04-26T22:21:21.392411+0000","last_active":"2024-04-26T22:21:22.433465+0000","last_peered":"2024-04-26T22:21:22.433465+0000","last_clean":"2024-04-26T22:21:22.433465+0000","last_became_active":"2024-04-26T22:21:21.392091+0000","last_became_peered":"2024-04-26T22:21:21.392091+0000","last_unstale":"2024-04-26T22:21:22.433465+0000","last_undegraded":"2024-04-26T22:21:22.433465+0000","last_fullsized":"2024-04-26T22:21:22.433465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:39.738654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423164+0000","last_change":"2024-04-26T22:21:22.415923+0000","last_active":"2024-04-26T22:21:22.423164+0000","last_peered":"2024-04-26T22:21:22.423164+0000","last_clean":"2024-04-26T22:21:22.423164+0000","last_became_active":"2024-04-26T22:21:22.415523+0000","last_became_peered":"2024-04-26T22:21:22.415523+0000","last_unstale":"2024-04-26T22:21:22.423164+0000","last_undegraded":"2024-04-26T22:21:22.423164+0000","last_fullsized":"2024-04-26T22:21:22.423164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:58.310966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395597+0000","last_change":"2024-04-26T22:21:21.397039+0000","last_active":"2024-04-26T22:21:22.395597+0000","last_peered":"2024-04-26T22:21:22.395597+0000","last_clean":"2024-04-26T22:21:22.395597+0000","last_became_active":"2024-04-26T22:21:21.395448+0000","last_became_peered":"2024-04-26T22:21:21.395448+0000","last_unstale":"2024-04-26T22:21:22.395597+0000","last_undegraded":"2024-04-26T22:21:22.395597+0000","last_fullsized":"2024-04-26T22:21:22.395597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.413049+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:22.413049+0000","last_peered":"2024-04-26T22:21:22.413049+0000","last_clean":"2024-04-26T22:21:22.413049+0000","last_became_active":"2024-04-26T22:21:22.406210+0000","last_became_peered":"2024-04-26T22:21:22.406210+0000","last_unstale":"2024-04-26T22:21:22.413049+0000","last_undegraded":"2024-04-26T22:21:22.413049+0000","last_fullsized":"2024-04-26T22:21:22.413049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408048+0000","last_change":"2024-04-26T22:21:21.395875+0000","last_active":"2024-04-26T22:21:23.408048+0000","last_peered":"2024-04-26T22:21:23.408048+0000","last_clean":"2024-04-26T22:21:23.408048+0000","last_became_active":"2024-04-26T22:21:21.395537+0000","last_became_peered":"2024-04-26T22:21:21.395537+0000","last_unstale":"2024-04-26T22:21:23.408048+0000","last_undegraded":"2024-04-26T22:21:23.408048+0000","last_fullsized":"2024-04-26T22:21:23.408048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409338+0000","last_change":"2024-04-26T22:21:22.401767+0000","last_active":"2024-04-26T22:21:23.409338+0000","last_peered":"2024-04-26T22:21:23.409338+0000","last_clean":"2024-04-26T22:21:23.409338+0000","last_became_active":"2024-04-26T22:21:22.401447+0000","last_became_peered":"2024-04-26T22:21:22.401447+0000","last_unstale":"2024-04-26T22:21:23.409338+0000","last_undegraded":"2024-04-26T22:21:23.409338+0000","last_fullsized":"2024-04-26T22:21:23.409338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.407992+0000","last_change":"2024-04-26T22:21:21.403885+0000","last_active":"2024-04-26T22:21:23.407992+0000","last_peered":"2024-04-26T22:21:23.407992+0000","last_clean":"2024-04-26T22:21:23.407992+0000","last_became_active":"2024-04-26T22:21:21.403438+0000","last_became_peered":"2024-04-26T22:21:21.403438+0000","last_unstale":"2024-04-26T22:21:23.407992+0000","last_undegraded":"2024-04-26T22:21:23.407992+0000","last_fullsized":"2024-04-26T22:21:23.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.412597+0000","last_change":"2024-04-26T22:21:22.411158+0000","last_active":"2024-04-26T22:21:22.412597+0000","last_peered":"2024-04-26T22:21:22.412597+0000","last_clean":"2024-04-26T22:21:22.412597+0000","last_became_active":"2024-04-26T22:21:22.410853+0000","last_became_peered":"2024-04-26T22:21:22.410853+0000","last_unstale":"2024-04-26T22:21:22.412597+0000","last_undegraded":"2024-04-26T22:21:22.412597+0000","last_fullsized":"2024-04-26T22:21:22.412597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408979+0000","last_change":"2024-04-26T22:21:21.392442+0000","last_active":"2024-04-26T22:21:23.408979+0000","last_peered":"2024-04-26T22:21:23.408979+0000","last_clean":"2024-04-26T22:21:23.408979+0000","last_became_active":"2024-04-26T22:21:21.389407+0000","last_became_peered":"2024-04-26T22:21:21.389407+0000","last_unstale":"2024-04-26T22:21:23.408979+0000","last_undegraded":"2024-04-26T22:21:23.408979+0000","last_fullsized":"2024-04-26T22:21:23.408979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.950669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410209+0000","last_change":"2024-04-26T22:21:22.406366+0000","last_active":"2024-04-26T22:21:22.410209+0000","last_peered":"2024-04-26T22:21:22.410209+0000","last_clean":"2024-04-26T22:21:22.410209+0000","last_became_active":"2024-04-26T22:21:22.406094+0000","last_became_peered":"2024-04-26T22:21:22.406094+0000","last_unstale":"2024-04-26T22:21:22.410209+0000","last_undegraded":"2024-04-26T22:21:22.410209+0000","last_fullsized":"2024-04-26T22:21:22.410209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408162+0000","last_change":"2024-04-26T22:21:21.396566+0000","last_active":"2024-04-26T22:21:23.408162+0000","last_peered":"2024-04-26T22:21:23.408162+0000","last_clean":"2024-04-26T22:21:23.408162+0000","last_became_active":"2024-04-26T22:21:21.396207+0000","last_became_peered":"2024-04-26T22:21:21.396207+0000","last_unstale":"2024-04-26T22:21:23.408162+0000","last_undegraded":"2024-04-26T22:21:23.408162+0000","last_fullsized":"2024-04-26T22:21:23.408162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410172+0000","last_change":"2024-04-26T22:21:22.405977+0000","last_active":"2024-04-26T22:21:22.410172+0000","last_peered":"2024-04-26T22:21:22.410172+0000","last_clean":"2024-04-26T22:21:22.410172+0000","last_became_active":"2024-04-26T22:21:22.405645+0000","last_became_peered":"2024-04-26T22:21:22.405645+0000","last_unstale":"2024-04-26T22:21:22.410172+0000","last_undegraded":"2024-04-26T22:21:22.410172+0000","last_fullsized":"2024-04-26T22:21:22.410172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412572+0000","last_change":"2024-04-26T22:21:21.405545+0000","last_active":"2024-04-26T22:21:23.412572+0000","last_peered":"2024-04-26T22:21:23.412572+0000","last_clean":"2024-04-26T22:21:23.412572+0000","last_became_active":"2024-04-26T22:21:21.403284+0000","last_became_peered":"2024-04-26T22:21:21.403284+0000","last_unstale":"2024-04-26T22:21:23.412572+0000","last_undegraded":"2024-04-26T22:21:23.412572+0000","last_fullsized":"2024-04-26T22:21:23.412572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425547+0000","last_change":"2024-04-26T22:21:22.415709+0000","last_active":"2024-04-26T22:21:22.425547+0000","last_peered":"2024-04-26T22:21:22.425547+0000","last_clean":"2024-04-26T22:21:22.425547+0000","last_became_active":"2024-04-26T22:21:22.414839+0000","last_became_peered":"2024-04-26T22:21:22.414839+0000","last_unstale":"2024-04-26T22:21:22.425547+0000","last_undegraded":"2024-04-26T22:21:22.425547+0000","last_fullsized":"2024-04-26T22:21:22.425547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408107+0000","last_change":"2024-04-26T22:21:21.397699+0000","last_active":"2024-04-26T22:21:23.408107+0000","last_peered":"2024-04-26T22:21:23.408107+0000","last_clean":"2024-04-26T22:21:23.408107+0000","last_became_active":"2024-04-26T22:21:21.397372+0000","last_became_peered":"2024-04-26T22:21:21.397372+0000","last_unstale":"2024-04-26T22:21:23.408107+0000","last_undegraded":"2024-04-26T22:21:23.408107+0000","last_fullsized":"2024-04-26T22:21:23.408107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.422300+0000","last_change":"2024-04-26T22:21:22.420982+0000","last_active":"2024-04-26T22:21:22.422300+0000","last_peered":"2024-04-26T22:21:22.422300+0000","last_clean":"2024-04-26T22:21:22.422300+0000","last_became_active":"2024-04-26T22:21:22.420729+0000","last_became_peered":"2024-04-26T22:21:22.420729+0000","last_unstale":"2024-04-26T22:21:22.422300+0000","last_undegraded":"2024-04-26T22:21:22.422300+0000","last_fullsized":"2024-04-26T22:21:22.422300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.390444+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:21:22.390444+0000","last_peered":"2024-04-26T22:21:22.390444+0000","last_clean":"2024-04-26T22:21:22.390444+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:21:22.390444+0000","last_undegraded":"2024-04-26T22:21:22.390444+0000","last_fullsized":"2024-04-26T22:21:22.390444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.392857+0000","last_change":"2024-04-26T22:21:21.400430+0000","last_active":"2024-04-26T22:21:22.392857+0000","last_peered":"2024-04-26T22:21:22.392857+0000","last_clean":"2024-04-26T22:21:22.392857+0000","last_became_active":"2024-04-26T22:21:21.400160+0000","last_became_peered":"2024-04-26T22:21:21.400160+0000","last_unstale":"2024-04-26T22:21:22.392857+0000","last_undegraded":"2024-04-26T22:21:22.392857+0000","last_fullsized":"2024-04-26T22:21:22.392857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.431573+0000","last_change":"2024-04-26T22:21:22.427326+0000","last_active":"2024-04-26T22:21:22.431573+0000","last_peered":"2024-04-26T22:21:22.431573+0000","last_clean":"2024-04-26T22:21:22.431573+0000","last_became_active":"2024-04-26T22:21:22.427067+0000","last_became_peered":"2024-04-26T22:21:22.427067+0000","last_unstale":"2024-04-26T22:21:22.431573+0000","last_undegraded":"2024-04-26T22:21:22.431573+0000","last_fullsized":"2024-04-26T22:21:22.431573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:39.508019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.394067+0000","last_change":"2024-04-26T22:21:21.407696+0000","last_active":"2024-04-26T22:21:22.394067+0000","last_peered":"2024-04-26T22:21:22.394067+0000","last_clean":"2024-04-26T22:21:22.394067+0000","last_became_active":"2024-04-26T22:21:21.406397+0000","last_became_peered":"2024-04-26T22:21:21.406397+0000","last_unstale":"2024-04-26T22:21:22.394067+0000","last_undegraded":"2024-04-26T22:21:22.394067+0000","last_fullsized":"2024-04-26T22:21:22.394067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:07.497430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423017+0000","last_change":"2024-04-26T22:21:22.413618+0000","last_active":"2024-04-26T22:21:22.423017+0000","last_peered":"2024-04-26T22:21:22.423017+0000","last_clean":"2024-04-26T22:21:22.423017+0000","last_became_active":"2024-04-26T22:21:22.413285+0000","last_became_peered":"2024-04-26T22:21:22.413285+0000","last_unstale":"2024-04-26T22:21:22.423017+0000","last_undegraded":"2024-04-26T22:21:22.423017+0000","last_fullsized":"2024-04-26T22:21:22.423017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:26.127151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408143+0000","last_change":"2024-04-26T22:21:21.392079+0000","last_active":"2024-04-26T22:21:23.408143+0000","last_peered":"2024-04-26T22:21:23.408143+0000","last_clean":"2024-04-26T22:21:23.408143+0000","last_became_active":"2024-04-26T22:21:21.391760+0000","last_became_peered":"2024-04-26T22:21:21.391760+0000","last_unstale":"2024-04-26T22:21:23.408143+0000","last_undegraded":"2024-04-26T22:21:23.408143+0000","last_fullsized":"2024-04-26T22:21:23.408143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412645+0000","last_change":"2024-04-26T22:21:22.392865+0000","last_active":"2024-04-26T22:21:23.412645+0000","last_peered":"2024-04-26T22:21:23.412645+0000","last_clean":"2024-04-26T22:21:23.412645+0000","last_became_active":"2024-04-26T22:21:22.392571+0000","last_became_peered":"2024-04-26T22:21:22.392571+0000","last_unstale":"2024-04-26T22:21:23.412645+0000","last_undegraded":"2024-04-26T22:21:23.412645+0000","last_fullsized":"2024-04-26T22:21:23.412645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.395602+0000","last_change":"2024-04-26T22:21:21.402750+0000","last_active":"2024-04-26T22:21:22.395602+0000","last_peered":"2024-04-26T22:21:22.395602+0000","last_clean":"2024-04-26T22:21:22.395602+0000","last_became_active":"2024-04-26T22:21:21.402348+0000","last_became_peered":"2024-04-26T22:21:21.402348+0000","last_unstale":"2024-04-26T22:21:22.395602+0000","last_undegraded":"2024-04-26T22:21:22.395602+0000","last_fullsized":"2024-04-26T22:21:22.395602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409547+0000","last_change":"2024-04-26T22:21:22.418638+0000","last_active":"2024-04-26T22:21:23.409547+0000","last_peered":"2024-04-26T22:21:23.409547+0000","last_clean":"2024-04-26T22:21:23.409547+0000","last_became_active":"2024-04-26T22:21:22.418047+0000","last_became_peered":"2024-04-26T22:21:22.418047+0000","last_unstale":"2024-04-26T22:21:23.409547+0000","last_undegraded":"2024-04-26T22:21:23.409547+0000","last_fullsized":"2024-04-26T22:21:23.409547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412552+0000","last_change":"2024-04-26T22:21:21.404376+0000","last_active":"2024-04-26T22:21:23.412552+0000","last_peered":"2024-04-26T22:21:23.412552+0000","last_clean":"2024-04-26T22:21:23.412552+0000","last_became_active":"2024-04-26T22:21:21.404115+0000","last_became_peered":"2024-04-26T22:21:21.404115+0000","last_unstale":"2024-04-26T22:21:23.412552+0000","last_undegraded":"2024-04-26T22:21:23.412552+0000","last_fullsized":"2024-04-26T22:21:23.412552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425690+0000","last_change":"2024-04-26T22:21:22.419797+0000","last_active":"2024-04-26T22:21:22.425690+0000","last_peered":"2024-04-26T22:21:22.425690+0000","last_clean":"2024-04-26T22:21:22.425690+0000","last_became_active":"2024-04-26T22:21:22.414517+0000","last_became_peered":"2024-04-26T22:21:22.414517+0000","last_unstale":"2024-04-26T22:21:22.425690+0000","last_undegraded":"2024-04-26T22:21:22.425690+0000","last_fullsized":"2024-04-26T22:21:22.425690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.391770+0000","last_change":"2024-04-26T22:21:21.405504+0000","last_active":"2024-04-26T22:21:22.391770+0000","last_peered":"2024-04-26T22:21:22.391770+0000","last_clean":"2024-04-26T22:21:22.391770+0000","last_became_active":"2024-04-26T22:21:21.405051+0000","last_became_peered":"2024-04-26T22:21:21.405051+0000","last_unstale":"2024-04-26T22:21:22.391770+0000","last_undegraded":"2024-04-26T22:21:22.391770+0000","last_fullsized":"2024-04-26T22:21:22.391770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:21.339836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412393+0000","last_change":"2024-04-26T22:21:22.392844+0000","last_active":"2024-04-26T22:21:23.412393+0000","last_peered":"2024-04-26T22:21:23.412393+0000","last_clean":"2024-04-26T22:21:23.412393+0000","last_became_active":"2024-04-26T22:21:22.392544+0000","last_became_peered":"2024-04-26T22:21:22.392544+0000","last_unstale":"2024-04-26T22:21:23.412393+0000","last_undegraded":"2024-04-26T22:21:23.412393+0000","last_fullsized":"2024-04-26T22:21:23.412393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.414226+0000","last_change":"2024-04-26T22:21:21.402324+0000","last_active":"2024-04-26T22:21:23.414226+0000","last_peered":"2024-04-26T22:21:23.414226+0000","last_clean":"2024-04-26T22:21:23.414226+0000","last_became_active":"2024-04-26T22:21:21.402029+0000","last_became_peered":"2024-04-26T22:21:21.402029+0000","last_unstale":"2024-04-26T22:21:23.414226+0000","last_undegraded":"2024-04-26T22:21:23.414226+0000","last_fullsized":"2024-04-26T22:21:23.414226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.432544+0000","last_change":"2024-04-26T22:21:22.429036+0000","last_active":"2024-04-26T22:21:22.432544+0000","last_peered":"2024-04-26T22:21:22.432544+0000","last_clean":"2024-04-26T22:21:22.432544+0000","last_became_active":"2024-04-26T22:21:22.417035+0000","last_became_peered":"2024-04-26T22:21:22.417035+0000","last_unstale":"2024-04-26T22:21:22.432544+0000","last_undegraded":"2024-04-26T22:21:22.432544+0000","last_fullsized":"2024-04-26T22:21:22.432544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:08.502863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408971+0000","last_change":"2024-04-26T22:21:21.396691+0000","last_active":"2024-04-26T22:21:23.408971+0000","last_peered":"2024-04-26T22:21:23.408971+0000","last_clean":"2024-04-26T22:21:23.408971+0000","last_became_active":"2024-04-26T22:21:21.395935+0000","last_became_peered":"2024-04-26T22:21:21.395935+0000","last_unstale":"2024-04-26T22:21:23.408971+0000","last_undegraded":"2024-04-26T22:21:23.408971+0000","last_fullsized":"2024-04-26T22:21:23.408971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.423275+0000","last_change":"2024-04-26T22:21:22.418914+0000","last_active":"2024-04-26T22:21:22.423275+0000","last_peered":"2024-04-26T22:21:22.423275+0000","last_clean":"2024-04-26T22:21:22.423275+0000","last_became_active":"2024-04-26T22:21:22.418549+0000","last_became_peered":"2024-04-26T22:21:22.418549+0000","last_unstale":"2024-04-26T22:21:22.423275+0000","last_undegraded":"2024-04-26T22:21:22.423275+0000","last_fullsized":"2024-04-26T22:21:22.423275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:31.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.390383+0000","last_change":"2024-04-26T22:21:21.406456+0000","last_active":"2024-04-26T22:21:22.390383+0000","last_peered":"2024-04-26T22:21:22.390383+0000","last_clean":"2024-04-26T22:21:22.390383+0000","last_became_active":"2024-04-26T22:21:21.406032+0000","last_became_peered":"2024-04-26T22:21:21.406032+0000","last_unstale":"2024-04-26T22:21:22.390383+0000","last_undegraded":"2024-04-26T22:21:22.390383+0000","last_fullsized":"2024-04-26T22:21:22.390383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408998+0000","last_change":"2024-04-26T22:21:22.394656+0000","last_active":"2024-04-26T22:21:23.408998+0000","last_peered":"2024-04-26T22:21:23.408998+0000","last_clean":"2024-04-26T22:21:23.408998+0000","last_became_active":"2024-04-26T22:21:22.394308+0000","last_became_peered":"2024-04-26T22:21:22.394308+0000","last_unstale":"2024-04-26T22:21:23.408998+0000","last_undegraded":"2024-04-26T22:21:23.408998+0000","last_fullsized":"2024-04-26T22:21:23.408998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412559+0000","last_change":"2024-04-26T22:21:21.410610+0000","last_active":"2024-04-26T22:21:23.412559+0000","last_peered":"2024-04-26T22:21:23.412559+0000","last_clean":"2024-04-26T22:21:23.412559+0000","last_became_active":"2024-04-26T22:21:21.410307+0000","last_became_peered":"2024-04-26T22:21:21.410307+0000","last_unstale":"2024-04-26T22:21:23.412559+0000","last_undegraded":"2024-04-26T22:21:23.412559+0000","last_fullsized":"2024-04-26T22:21:23.412559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425974+0000","last_change":"2024-04-26T22:21:22.403920+0000","last_active":"2024-04-26T22:21:22.425974+0000","last_peered":"2024-04-26T22:21:22.425974+0000","last_clean":"2024-04-26T22:21:22.425974+0000","last_became_active":"2024-04-26T22:21:22.403666+0000","last_became_peered":"2024-04-26T22:21:22.403666+0000","last_unstale":"2024-04-26T22:21:22.425974+0000","last_undegraded":"2024-04-26T22:21:22.425974+0000","last_fullsized":"2024-04-26T22:21:22.425974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412507+0000","last_change":"2024-04-26T22:21:21.402151+0000","last_active":"2024-04-26T22:21:23.412507+0000","last_peered":"2024-04-26T22:21:23.412507+0000","last_clean":"2024-04-26T22:21:23.412507+0000","last_became_active":"2024-04-26T22:21:21.401806+0000","last_became_peered":"2024-04-26T22:21:21.401806+0000","last_unstale":"2024-04-26T22:21:23.412507+0000","last_undegraded":"2024-04-26T22:21:23.412507+0000","last_fullsized":"2024-04-26T22:21:23.412507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.432611+0000","last_change":"2024-04-26T22:21:22.429169+0000","last_active":"2024-04-26T22:21:22.432611+0000","last_peered":"2024-04-26T22:21:22.432611+0000","last_clean":"2024-04-26T22:21:22.432611+0000","last_became_active":"2024-04-26T22:21:22.428796+0000","last_became_peered":"2024-04-26T22:21:22.428796+0000","last_unstale":"2024-04-26T22:21:22.432611+0000","last_undegraded":"2024-04-26T22:21:22.432611+0000","last_fullsized":"2024-04-26T22:21:22.432611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:13.149056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424814+0000","last_change":"2024-04-26T22:21:21.408709+0000","last_active":"2024-04-26T22:21:22.424814+0000","last_peered":"2024-04-26T22:21:22.424814+0000","last_clean":"2024-04-26T22:21:22.424814+0000","last_became_active":"2024-04-26T22:21:21.408242+0000","last_became_peered":"2024-04-26T22:21:21.408242+0000","last_unstale":"2024-04-26T22:21:22.424814+0000","last_undegraded":"2024-04-26T22:21:22.424814+0000","last_fullsized":"2024-04-26T22:21:22.424814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:38.502586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408033+0000","last_change":"2024-04-26T22:21:22.406897+0000","last_active":"2024-04-26T22:21:23.408033+0000","last_peered":"2024-04-26T22:21:23.408033+0000","last_clean":"2024-04-26T22:21:23.408033+0000","last_became_active":"2024-04-26T22:21:22.406614+0000","last_became_peered":"2024-04-26T22:21:22.406614+0000","last_unstale":"2024-04-26T22:21:23.408033+0000","last_undegraded":"2024-04-26T22:21:23.408033+0000","last_fullsized":"2024-04-26T22:21:23.408033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425625+0000","last_change":"2024-04-26T22:21:22.404257+0000","last_active":"2024-04-26T22:21:22.425625+0000","last_peered":"2024-04-26T22:21:22.425625+0000","last_clean":"2024-04-26T22:21:22.425625+0000","last_became_active":"2024-04-26T22:21:22.403954+0000","last_became_peered":"2024-04-26T22:21:22.403954+0000","last_unstale":"2024-04-26T22:21:22.425625+0000","last_undegraded":"2024-04-26T22:21:22.425625+0000","last_fullsized":"2024-04-26T22:21:22.425625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426042+0000","last_change":"2024-04-26T22:21:21.406486+0000","last_active":"2024-04-26T22:21:22.426042+0000","last_peered":"2024-04-26T22:21:22.426042+0000","last_clean":"2024-04-26T22:21:22.426042+0000","last_became_active":"2024-04-26T22:21:21.406190+0000","last_became_peered":"2024-04-26T22:21:21.406190+0000","last_unstale":"2024-04-26T22:21:22.426042+0000","last_undegraded":"2024-04-26T22:21:22.426042+0000","last_fullsized":"2024-04-26T22:21:22.426042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:45.631147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.425571+0000","last_change":"2024-04-26T22:21:22.415974+0000","last_active":"2024-04-26T22:21:22.425571+0000","last_peered":"2024-04-26T22:21:22.425571+0000","last_clean":"2024-04-26T22:21:22.425571+0000","last_became_active":"2024-04-26T22:21:22.415384+0000","last_became_peered":"2024-04-26T22:21:22.415384+0000","last_unstale":"2024-04-26T22:21:22.425571+0000","last_undegraded":"2024-04-26T22:21:22.425571+0000","last_fullsized":"2024-04-26T22:21:22.425571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.426483+0000","last_change":"2024-04-26T22:21:21.405267+0000","last_active":"2024-04-26T22:21:22.426483+0000","last_peered":"2024-04-26T22:21:22.426483+0000","last_clean":"2024-04-26T22:21:22.426483+0000","last_became_active":"2024-04-26T22:21:21.404669+0000","last_became_peered":"2024-04-26T22:21:21.404669+0000","last_unstale":"2024-04-26T22:21:22.426483+0000","last_undegraded":"2024-04-26T22:21:22.426483+0000","last_fullsized":"2024-04-26T22:21:22.426483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.424113+0000","last_change":"2024-04-26T22:21:22.422015+0000","last_active":"2024-04-26T22:21:22.424113+0000","last_peered":"2024-04-26T22:21:22.424113+0000","last_clean":"2024-04-26T22:21:22.424113+0000","last_became_active":"2024-04-26T22:21:22.421713+0000","last_became_peered":"2024-04-26T22:21:22.421713+0000","last_unstale":"2024-04-26T22:21:22.424113+0000","last_undegraded":"2024-04-26T22:21:22.424113+0000","last_fullsized":"2024-04-26T22:21:22.424113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:26.799919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.429001+0000","last_change":"2024-04-26T22:21:21.396531+0000","last_active":"2024-04-26T22:21:22.429001+0000","last_peered":"2024-04-26T22:21:22.429001+0000","last_clean":"2024-04-26T22:21:22.429001+0000","last_became_active":"2024-04-26T22:21:21.395948+0000","last_became_peered":"2024-04-26T22:21:21.395948+0000","last_unstale":"2024-04-26T22:21:22.429001+0000","last_undegraded":"2024-04-26T22:21:22.429001+0000","last_fullsized":"2024-04-26T22:21:22.429001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.410814+0000","last_change":"2024-04-26T22:21:22.406649+0000","last_active":"2024-04-26T22:21:22.410814+0000","last_peered":"2024-04-26T22:21:22.410814+0000","last_clean":"2024-04-26T22:21:22.410814+0000","last_became_active":"2024-04-26T22:21:22.406377+0000","last_became_peered":"2024-04-26T22:21:22.406377+0000","last_unstale":"2024-04-26T22:21:22.410814+0000","last_undegraded":"2024-04-26T22:21:22.410814+0000","last_fullsized":"2024-04-26T22:21:22.410814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T22:21:22.433823+0000","last_change":"2024-04-26T22:21:21.401403+0000","last_active":"2024-04-26T22:21:22.433823+0000","last_peered":"2024-04-26T22:21:22.433823+0000","last_clean":"2024-04-26T22:21:22.433823+0000","last_became_active":"2024-04-26T22:21:21.401028+0000","last_became_peered":"2024-04-26T22:21:21.401028+0000","last_unstale":"2024-04-26T22:21:22.433823+0000","last_undegraded":"2024-04-26T22:21:22.433823+0000","last_fullsized":"2024-04-26T22:21:22.433823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:19.445168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":660934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":71596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":208896,"data_stored":69984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":660990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:21:26.907 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:21:26.907 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T22:21:26.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T22:21:26.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T22:21:26.908 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T22:21:27.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.084+0000 7f62e1c00640 1 Processor -- start 2024-04-26T22:21:27.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.084+0000 7f62e1c00640 1 -- start start 2024-04-26T22:21:27.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62e1c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 0x7f62dc0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62e1c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62dc0b05e0 con 0x7f62dc1400d0 2024-04-26T22:21:27.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62e1c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62dc0b6890 con 0x7f62dc0739d0 2024-04-26T22:21:27.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62e1c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc073db0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62db400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f62dc1400d0 0x7f62dc140540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59412/0 (socket says 172.21.15.16:59412) 2024-04-26T22:21:27.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62db400640 1 -- 172.21.15.16:0/1151275185 learned_addr learned my addr 172.21.15.16:0/1151275185 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:27.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62da000640 1 --2- 172.21.15.16:0/1151275185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 0x7f62dc0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862994418 0 0) 0x7f62dc0b05e0 con 0x7f62dc1400d0 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c0003530 con 0x7f62dc1400d0 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62da000640 1 -- 172.21.15.16:0/1151275185 >> v1:172.21.15.195:6789/0 conn(0x7f62dc0739d0 legacy=0x7f62dc149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069168157 0 0) 0x7f62dc0b6890 con 0x7f62dc0739d0 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62da000640 1 -- 172.21.15.16:0/1151275185 >> v1:172.21.15.16:6789/0 conn(0x7f62dc1400d0 legacy=0x7f62dc140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.088+0000 7f62da000640 1 -- 172.21.15.16:0/1151275185 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc14a0b0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62da000640 1 --2- 172.21.15.16:0/1151275185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 0x7f62dc0b6350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ebdfe661c40d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c80b0070 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c80ab600 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62d9600640 1 -- 172.21.15.16:0/1151275185 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c80ab9b0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- 172.21.15.16:0/1151275185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 msgr2=0x7f62dc0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 --2- 172.21.15.16:0/1151275185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 0x7f62dc0b6350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c801c450 comp rx=0 tx=0).stop 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- 172.21.15.16:0/1151275185 shutdown_connections 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 --2- 172.21.15.16:0/1151275185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0b5ee0 0x7f62dc0b6350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- 172.21.15.16:0/1151275185 >> 172.21.15.16:0/1151275185 conn(0x7f62dc0bab10 msgr2=0x7f62dc0baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- 172.21.15.16:0/1151275185 shutdown_connections 2024-04-26T22:21:27.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- 172.21.15.16:0/1151275185 wait complete. 2024-04-26T22:21:27.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 Processor -- start 2024-04-26T22:21:27.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- start start 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0739d0 0x7f62dc132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62dc1400d0 0x7f62dc138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc154480 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc0b5b60 con 0x7f62dc1400d0 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62e1c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62dc154600 con 0x7f62dc0739d0 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.092+0000 7f62da000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41502/0 (socket says 172.21.15.16:41502) 2024-04-26T22:21:27.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 -- 172.21.15.16:0/3754015242 learned_addr learned my addr 172.21.15.16:0/3754015242 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62daa00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0739d0 0x7f62dc132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62db400640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62dc1400d0 0x7f62dc138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 -- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0739d0 msgr2=0x7f62dc132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0739d0 0x7f62dc132850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 -- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62dc1400d0 msgr2=0x7f62dc138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62dc1400d0 0x7f62dc138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 -- 172.21.15.16:0/3754015242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc149180 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62da000640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c80b9070 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c80ab9b0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c80b0040 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc1e46a0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc148ea0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62dc0ba5f0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.096+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62c8003620 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.100+0000 7f62d2a00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 0x7f62bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.100+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f62c811fa40 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.100+0000 7f62daa00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 0x7f62bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.100+0000 7f62daa00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 0x7f62bc06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62cc007fd0 tx=0x7f62cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.104+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f62c80160d0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.304+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f62dc13fe50 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.308+0000 7f62d2a00640 1 -- 172.21.15.16:0/3754015242 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168091 (secure 0 0 0) 0x7f62c80ef9a0 con 0x7f62dc0b5ee0 2024-04-26T22:21:27.312 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:27.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 msgr2=0x7f62bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 0x7f62bc06a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62cc007fd0 tx=0x7f62cc009040 comp rx=0 tx=0).stop 2024-04-26T22:21:27.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 msgr2=0x7f62dc1474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f62c80097f0 tx=0x7f62c80191f0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 shutdown_connections 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62bc0683b0 0x7f62bc06a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62dc1400d0 0x7f62dc138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62dc0b5ee0 0x7f62dc1474f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 --2- 172.21.15.16:0/3754015242 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62dc0739d0 0x7f62dc132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 >> 172.21.15.16:0/3754015242 conn(0x7f62dc0bab10 msgr2=0x7f62dc0b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 shutdown_connections 2024-04-26T22:21:27.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.312+0000 7f62e1c00640 1 -- 172.21.15.16:0/3754015242 wait complete. 2024-04-26T22:21:27.332 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3987169006},{"type":"v1","addr":"172.21.15.195:6833","nonce":3987169006}]},"active_addr":"172.21.15.195:6833/3987169006","active_change":"2024-04-26T22:21:02.089220+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":799085473}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":2615527939}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":2108325643}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.195:0","nonce":3541308632}]}]} 2024-04-26T22:21:27.335 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T22:21:27.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T22:21:27.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:27.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 Processor -- start 2024-04-26T22:21:27.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 -- start start 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab700b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab70068780 con 0x7fab700683a0 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab700b6210 con 0x7fab700b5d30 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab76e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fab700b64f0 con 0x7fab700b6890 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fab700683a0 0x7fab70073820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59428/0 (socket says 172.21.15.16:59428) 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6fe00640 1 -- 172.21.15.16:0/3439901946 learned_addr learned my addr 172.21.15.16:0/3439901946 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab700b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145568605 0 0) 0x7fab70068780 con 0x7fab700683a0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab54003530 con 0x7fab700683a0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 780623392 0 0) 0x7fab54003530 con 0x7fab700683a0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 msgr2=0x7fab700b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab700b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 >> v1:172.21.15.195:6789/0 conn(0x7fab700b5d30 legacy=0x7fab70148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab700a0380 con 0x7fab700683a0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fab60001680 con 0x7fab700683a0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 >> v1:172.21.15.16:6789/0 conn(0x7fab700683a0 legacy=0x7fab70073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab540039f0 0x7fab54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fab700b64f0 con 0x7fab54004810 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400bb00 con 0x7fab540039f0 2024-04-26T22:21:27.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fab5400bd00 con 0x7fab700b6890 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab6fe00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab540039f0 0x7fab54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab74e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 -- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 msgr2=0x7fab54005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab700b6890 0x7fab54005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 -- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab540039f0 msgr2=0x7fab54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab540039f0 0x7fab54003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.476+0000 7fab67e00640 1 -- 172.21.15.16:0/3439901946 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab54003530 con 0x7fab54004810 2024-04-26T22:21:27.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab67e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab54004810 0x7fab54004c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab58009ab0 tx=0x7fab5801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d503a50872cd6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580b2070 con 0x7fab54004810 2024-04-26T22:21:27.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab700b7130 con 0x7fab54004810 2024-04-26T22:21:27.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab6f400640 1 -- 172.21.15.16:0/3439901946 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580096b0 con 0x7fab54004810 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 -- 172.21.15.16:0/3439901946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab54004810 msgr2=0x7fab54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 --2- 172.21.15.16:0/3439901946 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab54004810 0x7fab54004c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab58009ab0 tx=0x7fab5801ca50 comp rx=0 tx=0).stop 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab74e00640 1 -- 172.21.15.16:0/3439901946 reap_dead start 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 -- 172.21.15.16:0/3439901946 shutdown_connections 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 -- 172.21.15.16:0/3439901946 >> 172.21.15.16:0/3439901946 conn(0x7fab700bab10 msgr2=0x7fab700baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 -- 172.21.15.16:0/3439901946 shutdown_connections 2024-04-26T22:21:27.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.480+0000 7fab76e00640 1 -- 172.21.15.16:0/3439901946 wait complete. 2024-04-26T22:21:27.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 Processor -- start 2024-04-26T22:21:27.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- start start 2024-04-26T22:21:27.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab54004810 0x7fab70151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab70143d00 0x7fab7013cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fab70154b40 con 0x7fab7013d420 2024-04-26T22:21:27.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fab701549c0 con 0x7fab54004810 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fab70154cc0 con 0x7fab70143d00 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41530/0 (socket says 172.21.15.16:41530) 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 -- 172.21.15.16:0/3683881814 learned_addr learned my addr 172.21.15.16:0/3683881814 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab67e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab70143d00 0x7fab7013cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab6fe00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab54004810 0x7fab70151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 -- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab70143d00 msgr2=0x7fab7013cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab70143d00 0x7fab7013cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 -- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab54004810 msgr2=0x7fab70151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab54004810 0x7fab70151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 -- 172.21.15.16:0/3683881814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab70072710 con 0x7fab7013d420 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab74e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab700b6140 tx=0x7fab6800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6801a070 con 0x7fab7013d420 2024-04-26T22:21:27.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68006d70 con 0x7fab7013d420 2024-04-26T22:21:27.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68003ba0 con 0x7fab7013d420 2024-04-26T22:21:27.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab700729f0 con 0x7fab7013d420 2024-04-26T22:21:27.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab70072fb0 con 0x7fab7013d420 2024-04-26T22:21:27.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.484+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab70069530 con 0x7fab7013d420 2024-04-26T22:21:27.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.488+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab68005110 con 0x7fab7013d420 2024-04-26T22:21:27.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.488+0000 7fab6cc00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 0x7fab4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.488+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fab68086050 con 0x7fab7013d420 2024-04-26T22:21:27.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.488+0000 7fab6fe00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 0x7fab4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.488+0000 7fab6fe00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 0x7fab4c06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c10 tx=0x7fab60007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.492+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fab68055fb0 con 0x7fab7013d420 2024-04-26T22:21:27.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.656+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab700a0ec0 con 0x7fab7013d420 2024-04-26T22:21:27.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.656+0000 7fab6cc00640 1 -- 172.21.15.16:0/3683881814 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fab6805a2b0 con 0x7fab7013d420 2024-04-26T22:21:27.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:27.658 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 msgr2=0x7fab4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 0x7fab4c06a870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c10 tx=0x7fab60007900 comp rx=0 tx=0).stop 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 msgr2=0x7fab701e1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab700b6140 tx=0x7fab6800fcd0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 shutdown_connections 2024-04-26T22:21:27.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fab4c0683b0 0x7fab4c06a870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7013d420 0x7fab701e1500 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fab70143d00 0x7fab7013cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 --2- 172.21.15.16:0/3683881814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab54004810 0x7fab70151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 >> 172.21.15.16:0/3683881814 conn(0x7fab700bab10 msgr2=0x7fab70148b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 shutdown_connections 2024-04-26T22:21:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.660+0000 7fab76e00640 1 -- 172.21.15.16:0/3683881814 wait complete. 2024-04-26T22:21:27.679 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T22:21:27.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:27.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.816+0000 7f565ec00640 1 Processor -- start 2024-04-26T22:21:27.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 -- start start 2024-04-26T22:21:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56580b7b10 0x7f5658148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56580b7460 0x7f5658152c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56580b8650 con 0x7f56580b8b60 2024-04-26T22:21:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f565806caf0 con 0x7f56580b7460 2024-04-26T22:21:27.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f56580b6e40 con 0x7f56580b7b10 2024-04-26T22:21:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56580b7460 0x7f5658152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56580b7460 0x7f5658152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41542/0 (socket says 172.21.15.16:41542) 2024-04-26T22:21:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 -- 172.21.15.16:0/158751258 learned_addr learned my addr 172.21.15.16:0/158751258 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565d800640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56580b7b10 0x7f5658148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 -- 172.21.15.16:0/158751258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56580b7b10 msgr2=0x7f5658148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56580b7b10 0x7f5658148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 -- 172.21.15.16:0/158751258 >> v1:172.21.15.195:6789/0 conn(0x7f56580b8b60 legacy=0x7f5658142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.820+0000 7f565e200640 1 -- 172.21.15.16:0/158751258 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56580b7120 con 0x7f56580b7460 2024-04-26T22:21:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565e200640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658152c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2404f7bcf46e669 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f5657e00640 1 -- 172.21.15.16:0/158751258 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500a5770 con 0x7f56580b7460 2024-04-26T22:21:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f5657e00640 1 -- 172.21.15.16:0/158751258 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56500a5910 con 0x7f56580b7460 2024-04-26T22:21:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f5657e00640 1 -- 172.21.15.16:0/158751258 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500a5ce0 con 0x7f56580b7460 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- 172.21.15.16:0/158751258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 msgr2=0x7f5658152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658152c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5650009e50 tx=0x7f565001c9a0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- 172.21.15.16:0/158751258 shutdown_connections 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658152c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 --2- 172.21.15.16:0/158751258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56580b7b10 0x7f5658148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- 172.21.15.16:0/158751258 >> 172.21.15.16:0/158751258 conn(0x7f565806f500 msgr2=0x7f565806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- 172.21.15.16:0/158751258 shutdown_connections 2024-04-26T22:21:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- 172.21.15.16:0/158751258 wait complete. 2024-04-26T22:21:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 Processor -- start 2024-04-26T22:21:27.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 -- start start 2024-04-26T22:21:27.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.824+0000 7f565ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56580b7b10 0x7f5658143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56581e1470 0x7f5658144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56581559b0 con 0x7f56580b7460 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5658142b70 con 0x7f56580b7b10 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5658155b30 con 0x7f56581e1470 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41546/0 (socket says 172.21.15.16:41546) 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 -- 172.21.15.16:0/1871494067 learned_addr learned my addr 172.21.15.16:0/1871494067 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565e200640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56581e1470 0x7f5658144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ce00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56580b7b10 0x7f5658143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 -- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56581e1470 msgr2=0x7f5658144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56581e1470 0x7f5658144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 -- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56580b7b10 msgr2=0x7f5658143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56580b7b10 0x7f5658143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 -- 172.21.15.16:0/1871494067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56581e1960 con 0x7f56580b7460 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565d800640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f564c00e870 tx=0x7f564c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c017070 con 0x7f56580b7460 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c00c8e0 con 0x7f56580b7460 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c00cc90 con 0x7f56580b7460 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56581e1c40 con 0x7f56580b7460 2024-04-26T22:21:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565813f510 con 0x7f56580b7460 2024-04-26T22:21:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565806e570 con 0x7f56580b7460 2024-04-26T22:21:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.828+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f564c01a070 con 0x7f56580b7460 2024-04-26T22:21:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.832+0000 7f5655600640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 0x7f563806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.832+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f564c086be0 con 0x7f56580b7460 2024-04-26T22:21:27.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.832+0000 7f565ce00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 0x7f563806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:27.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.832+0000 7f565ce00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 0x7f563806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56581e2080 tx=0x7f5644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:27.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:27.836+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f564c057190 con 0x7f56580b7460 2024-04-26T22:21:28.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5658143860 con 0x7f56580b7460 2024-04-26T22:21:28.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f5655600640 1 -- 172.21.15.16:0/1871494067 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f564c056a90 con 0x7f56580b7460 2024-04-26T22:21:28.005 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:28.005 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:28.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 msgr2=0x7f563806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 0x7f563806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56581e2080 tx=0x7f5644009040 comp rx=0 tx=0).stop 2024-04-26T22:21:28.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 msgr2=0x7f5658142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f564c00e870 tx=0x7f564c00ec70 comp rx=0 tx=0).stop 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 shutdown_connections 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5638068380 0x7f563806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56581e1470 0x7f5658144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56580b7b10 0x7f5658143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 --2- 172.21.15.16:0/1871494067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b7460 0x7f5658142f80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.004+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 >> 172.21.15.16:0/1871494067 conn(0x7f565806f500 msgr2=0x7f56581469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.008+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 shutdown_connections 2024-04-26T22:21:28.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.008+0000 7f565ec00640 1 -- 172.21.15.16:0/1871494067 wait complete. 2024-04-26T22:21:28.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T22:21:28.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T22:21:28.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T22:21:28.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T22:21:28.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T22:21:28.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T22:21:28.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T22:21:28.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T22:21:28.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.272+0000 7f82e3200640 1 Processor -- start 2024-04-26T22:21:28.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.272+0000 7f82e3200640 1 -- start start 2024-04-26T22:21:28.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e3200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f82e406e920 0x7f82e40737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e3200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40b1c30 con 0x7f82e40b6800 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e3200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40b1f10 con 0x7f82e4148c10 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e3200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f82e40b2710 con 0x7f82e406e920 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e1400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f82e40b6800 0x7f82e4147910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59432/0 (socket says 172.21.15.16:59432) 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e1400640 1 -- 172.21.15.16:0/3624028497 learned_addr learned my addr 172.21.15.16:0/3624028497 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e1e00640 1 --2- 172.21.15.16:0/3624028497 >> v2:172.21.15.195:3300/0 conn(0x7f82e406e920 0x7f82e40737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687079754 0 0) 0x7f82e40b1f10 con 0x7f82e4148c10 2024-04-26T22:21:28.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c8003530 con 0x7f82e4148c10 2024-04-26T22:21:28.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754752444 0 0) 0x7f82e40b1c30 con 0x7f82e40b6800 2024-04-26T22:21:28.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e40b1f10 con 0x7f82e40b6800 2024-04-26T22:21:28.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 735974668 0 0) 0x7f82c8003530 con 0x7f82e4148c10 2024-04-26T22:21:28.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 >> v2:172.21.15.195:3300/0 conn(0x7f82e406e920 msgr2=0x7f82e40737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 --2- 172.21.15.16:0/3624028497 >> v2:172.21.15.195:3300/0 conn(0x7f82e406e920 0x7f82e40737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 >> v1:172.21.15.16:6789/0 conn(0x7f82e40b6800 legacy=0x7f82e4147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40b16f0 con 0x7f82e4148c10 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f82d40015b0 con 0x7f82e4148c10 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 >> v1:172.21.15.195:6789/0 conn(0x7f82e4148c10 legacy=0x7f82e4149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82c8004c00 0x7f82c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c80037b0 0x7f82c8003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 0x7f82c800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40b2710 con 0x7f82c8004c00 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f82c800c270 con 0x7f82c80037b0 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f82c800c470 con 0x7f82c8004240 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e1400640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c80037b0 0x7f82c8003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.276+0000 7f82e2800640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 0x7f82c800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f82e2800640 1 -- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c80037b0 msgr2=0x7f82c8003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f82e2800640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c80037b0 0x7f82c8003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f82e2800640 1 -- 172.21.15.16:0/3624028497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82c8004c00 msgr2=0x7f82c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f82e2800640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82c8004c00 0x7f82c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f82e2800640 1 -- 172.21.15.16:0/3624028497 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40b16f0 con 0x7f82c8004240 2024-04-26T22:21:28.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7fc2dda00640 1 Processor -- start 2024-04-26T22:21:28.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7fec56400640 1 Processor -- start 2024-04-26T22:21:28.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7fc2dda00640 1 -- start start 2024-04-26T22:21:28.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7fec56400640 1 -- start start 2024-04-26T22:21:28.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f5c79c00640 1 Processor -- start 2024-04-26T22:21:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7f5c79c00640 1 -- start start 2024-04-26T22:21:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.280+0000 7fb248e00640 1 Processor -- start 2024-04-26T22:21:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fb248e00640 1 -- start start 2024-04-26T22:21:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec56400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 0x7fec500b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 0x7fc2d8074430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc2d8075780 0x7fc2d80b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 0x7fc2d8148030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80b4610 con 0x7fc2d8075c00 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d8144d90 con 0x7fc2d8075780 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2dda00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d8145070 con 0x7fc2d80b3680 2024-04-26T22:21:28.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c79c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c740b6910 0x7f5c741462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec56400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 0x7fec501508d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec56400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500be2f0 con 0x7fec5006d100 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec56400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fec500b74a0 con 0x7fec500b7930 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec56400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fec500b7d90 con 0x7fec500bdf10 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec5006d100 0x7fec501501c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59444/0 (socket says 172.21.15.16:59444) 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4ea00640 1 -- 172.21.15.16:0/104777947 learned_addr learned my addr 172.21.15.16:0/104777947 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f82e2800640 1 -- 172.21.15.16:0/3624028497 reap_dead start 2024-04-26T22:21:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc2d8075780 0x7fc2d80b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c79c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c740735d0 0x7f5c74150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c73400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f5c741467f0 0x7f5c74072ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47422/0 (socket says 172.21.15.16:47422) 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4f400640 1 --2- 172.21.15.16:0/104777947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 0x7fec500b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4e000640 1 -- 172.21.15.16:0/104777947 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356406440 0 0) 0x7fec500be2f0 con 0x7fec5006d100 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 0x7fc2d8074430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 0x7fc2d8074430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41818/0 (socket says 172.21.15.16:41818) 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6a00640 1 -- 172.21.15.16:0/3843254334 learned_addr learned my addr 172.21.15.16:0/3843254334 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 0x7fc2d8148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4e000640 1 -- 172.21.15.16:0/104777947 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec34003530 con 0x7fec5006d100 2024-04-26T22:21:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f82e2800640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 0x7f82c800ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82d4007f80 tx=0x7f82d401caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08e54055e25dc62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 -- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 msgr2=0x7fc2d8074430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 --2- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 0x7fc2d8074430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 -- 172.21.15.16:0/3843254334 >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 msgr2=0x7fc2d8148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 --2- 172.21.15.16:0/3843254334 >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 0x7fc2d8148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4fe00640 1 --2- 172.21.15.16:0/104777947 >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 0x7fec501508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4f400640 1 -- 172.21.15.16:0/104777947 >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 msgr2=0x7fec501508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4f400640 1 --2- 172.21.15.16:0/104777947 >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 0x7fec501508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4f400640 1 -- 172.21.15.16:0/104777947 >> v1:172.21.15.16:6789/0 conn(0x7fec5006d100 legacy=0x7fec501501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c73400640 1 -- 172.21.15.16:0/1752341191 learned_addr learned my addr 172.21.15.16:0/1752341191 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1752341191 >> v2:172.21.15.16:3300/0 conn(0x7f5c740b6910 0x7f5c741462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c74146c50 con 0x7f5c741467f0 2024-04-26T22:21:28.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4f400640 1 -- 172.21.15.16:0/104777947 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500b8ba0 con 0x7fec500bdf10 2024-04-26T22:21:28.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fec4fe00640 1 --2- 172.21.15.16:0/104777947 >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 0x7fec501508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5c740b5f90 con 0x7f5c740b6910 2024-04-26T22:21:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885726313 0 0) 0x7f5c74146c50 con 0x7f5c741467f0 2024-04-26T22:21:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7f5c79200640 1 --2- 172.21.15.16:0/1752341191 >> v2:172.21.15.195:3300/0 conn(0x7f5c740735d0 0x7f5c74150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.284+0000 7fc2d6000640 1 -- 172.21.15.16:0/3843254334 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8145350 con 0x7fc2d8075780 2024-04-26T22:21:28.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5c740b6cf0 con 0x7f5c740735d0 2024-04-26T22:21:28.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fc2d7400640 1 --2- 172.21.15.16:0/3843254334 >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 0x7fc2d8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:28.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb248e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2440b6ae0 0x7fb244144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c58003530 con 0x7f5c741467f0 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb248e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24414cbb0 0x7fb24414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb248e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2440b3640 con 0x7fb2440b25d0 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb248e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb2440b15d0 con 0x7fb2440b6ae0 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb248e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb244073de0 con 0x7fb24414cbb0 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4007b80 con 0x7f82c8004240 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d40a5770 con 0x7f82c8004240 2024-04-26T22:21:28.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e0a00640 1 -- 172.21.15.16:0/3624028497 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40a5b40 con 0x7f82c8004240 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2440b6ae0 0x7fb244144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c73e00640 1 -- 172.21.15.16:0/1752341191 >> v2:172.21.15.195:3300/0 conn(0x7f5c740735d0 msgr2=0x7f5c74150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1752341191 >> v2:172.21.15.195:3300/0 conn(0x7f5c740735d0 0x7f5c74150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c73e00640 1 -- 172.21.15.16:0/1752341191 >> v1:172.21.15.195:6789/0 conn(0x7f5c741467f0 legacy=0x7f5c74072ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb2440b6ae0 0x7fb244144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57770/0 (socket says 172.21.15.16:57770) 2024-04-26T22:21:28.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 -- 172.21.15.16:0/2946293629 learned_addr learned my addr 172.21.15.16:0/2946293629 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199580612 0 0) 0x7f5c58003530 con 0x7f5c741467f0 2024-04-26T22:21:28.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f5c73e00640 1 -- 172.21.15.16:0/1752341191 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c74071800 con 0x7f5c740b6910 2024-04-26T22:21:28.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 -- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 msgr2=0x7f82c800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 0x7f82c800ba50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f82d4007f80 tx=0x7f82d401caa0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 -- 172.21.15.16:0/3624028497 shutdown_connections 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 --2- 172.21.15.16:0/3624028497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82c8004240 0x7f82c800ba50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 -- 172.21.15.16:0/3624028497 >> 172.21.15.16:0/3624028497 conn(0x7f82e4068310 msgr2=0x7f82e4068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 -- 172.21.15.16:0/3624028497 shutdown_connections 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7f82e3200640 1 -- 172.21.15.16:0/3624028497 wait complete. 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 -- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24414cbb0 msgr2=0x7fb24414efa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 --2- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24414cbb0 0x7fb24414efa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 -- 172.21.15.16:0/2946293629 >> v1:172.21.15.16:6789/0 conn(0x7fb2440b25d0 legacy=0x7fb2440736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.288+0000 7fb243400640 1 -- 172.21.15.16:0/2946293629 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2440b6ec0 con 0x7fb2440b6ae0 2024-04-26T22:21:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 Processor -- start 2024-04-26T22:21:28.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2d6000640 1 --2- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d80b18b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80b7e20 tx=0x7fc2c801c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa51b058293d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 Processor -- start 2024-04-26T22:21:28.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 -- start start 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2d5600640 1 -- 172.21.15.16:0/3843254334 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80b0070 con 0x7fc2d8075780 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2d5600640 1 -- 172.21.15.16:0/3843254334 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c80ab600 con 0x7fc2d8075780 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2d5600640 1 -- 172.21.15.16:0/3843254334 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80ab9d0 con 0x7fc2d8075780 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec4f400640 1 --2- 172.21.15.16:0/104777947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 0x7fec500b8540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec48009d90 tx=0x7fec4801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26786290b96870a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec4e000640 1 -- 172.21.15.16:0/104777947 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480b2070 con 0x7fec500bdf10 2024-04-26T22:21:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 Processor -- start 2024-04-26T22:21:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec4e000640 1 -- 172.21.15.16:0/104777947 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec480a58b0 con 0x7fec500bdf10 2024-04-26T22:21:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec4e000640 1 -- 172.21.15.16:0/104777947 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480a5c80 con 0x7fec500bdf10 2024-04-26T22:21:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 -- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 msgr2=0x7fc2d80b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 0x7f4a18144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 -- start start 2024-04-26T22:21:28.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a180b25d0 0x7f4a180736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d80b18b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80b7e20 tx=0x7fc2c801c0c0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 -- start start 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f197806e130 0x7f197814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 0x7f1978150420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197806e510 con 0x7f19780b3bd0 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f19780b6240 con 0x7f19780b1020 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f197da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f19780b3740 con 0x7f197806e130 2024-04-26T22:21:28.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a180b3640 con 0x7f4a181477e0 2024-04-26T22:21:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4a180b15d0 con 0x7f4a180b25d0 2024-04-26T22:21:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a17e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a180b6ec0 con 0x7f4a180b6ae0 2024-04-26T22:21:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1752341191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c740b6910 0x7f5c741462b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c740b6110 tx=0x7f5c6401c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caea74bc218552f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c640b0070 con 0x7f5c740b6910 2024-04-26T22:21:28.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 -- 172.21.15.16:0/3843254334 shutdown_connections 2024-04-26T22:21:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c640ab400 con 0x7f5c740b6910 2024-04-26T22:21:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3843254334 >> v2:172.21.15.16:3300/0 conn(0x7fc2d8075c00 0x7fc2d8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f5c72a00640 1 -- 172.21.15.16:0/1752341191 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60001680 con 0x7f5c740b6910 2024-04-26T22:21:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fb243400640 1 --2- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2440b6ae0 0x7fb244144260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009870 tx=0x7fb23c01c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43fce3d30fb02054 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8004240 0x7f82e4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 0x7f4a18144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f1976000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f19780b3bd0 0x7f1978149450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47432/0 (socket says 172.21.15.16:47432) 2024-04-26T22:21:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f1976000640 1 -- 172.21.15.16:0/1376632019 learned_addr learned my addr 172.21.15.16:0/1376632019 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82e413f510 0x7f82e41dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82e41dcbe0 0x7f82e41dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d80b18b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3843254334 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d80b3680 0x7fc2d8074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fc2dda00640 1 -- 172.21.15.16:0/3843254334 >> 172.21.15.16:0/3843254334 conn(0x7fc2d80ba2c0 msgr2=0x7fc2d80ba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 -- 172.21.15.16:0/104777947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 msgr2=0x7fec500b8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 --2- 172.21.15.16:0/104777947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 0x7fec500b8540 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec48009d90 tx=0x7fec4801c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fb242000640 1 -- 172.21.15.16:0/2946293629 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0b2070 con 0x7fb2440b6ae0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8004240 0x7f82e4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40b3df0 con 0x7f82e413f510 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40b3c70 con 0x7f82c8004240 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8004240 0x7f82e4147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57814/0 (socket says 172.21.15.16:57814) 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e3200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40737f0 con 0x7f82e41dcbe0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f82e1e00640 1 -- 172.21.15.16:0/3930817971 learned_addr learned my addr 172.21.15.16:0/3930817971 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82e413f510 0x7f82e41dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e2800640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82e41dcbe0 0x7f82e41dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f1977400640 1 --2- 172.21.15.16:0/1376632019 >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 0x7f1978150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1976a00640 1 --2- 172.21.15.16:0/1376632019 >> v2:172.21.15.195:3300/0 conn(0x7f197806e130 0x7f197814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250485034 0 0) 0x7f197806e510 con 0x7f19780b3bd0 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 -- 172.21.15.16:0/104777947 shutdown_connections 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 --2- 172.21.15.16:0/104777947 >> v2:172.21.15.16:3300/0 conn(0x7fec500b7930 0x7fec501508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 --2- 172.21.15.16:0/104777947 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500bdf10 0x7fec500b8540 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fec48009d90 tx=0x7fec4801c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7fec56400640 1 -- 172.21.15.16:0/104777947 >> 172.21.15.16:0/104777947 conn(0x7fec500beda0 msgr2=0x7fec500bf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb242000640 1 -- 172.21.15.16:0/2946293629 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c0ad680 con 0x7fb2440b6ae0 2024-04-26T22:21:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c740b6910 msgr2=0x7f5c741462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1752341191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c740b6910 0x7f5c741462b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5c740b6110 tx=0x7f5c6401c2c0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a16000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4a180b25d0 0x7f4a180736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 0x7f4a18144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41846/0 (socket says 172.21.15.16:41846) 2024-04-26T22:21:28.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.292+0000 7f4a16a00640 1 -- 172.21.15.16:0/2863165288 learned_addr learned my addr 172.21.15.16:0/2863165288 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 -- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82e41dcbe0 msgr2=0x7f82e41dfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82e41dcbe0 0x7f82e41dfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 -- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8004240 msgr2=0x7f82e4147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c8004240 0x7f82e4147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e41dd060 con 0x7f82e413f510 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fc2dda00640 1 -- 172.21.15.16:0/3843254334 shutdown_connections 2024-04-26T22:21:28.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f195c003530 con 0x7f19780b3bd0 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb242000640 1 -- 172.21.15.16:0/2946293629 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0ada50 con 0x7fb2440b6ae0 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f4a15600640 1 -- 172.21.15.16:0/2863165288 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066407227 0 0) 0x7f4a180b3640 con 0x7f4a181477e0 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f4a16000640 1 -- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 msgr2=0x7f4a18144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f4a16000640 1 --2- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 0x7f4a18144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f4a16000640 1 -- 172.21.15.16:0/2863165288 >> v1:172.21.15.195:6789/0 conn(0x7f4a181477e0 legacy=0x7f4a18147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f4a16000640 1 -- 172.21.15.16:0/2863165288 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a180b1220 con 0x7f4a180b25d0 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fec56400640 1 -- 172.21.15.16:0/104777947 shutdown_connections 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fec56400640 1 -- 172.21.15.16:0/104777947 wait complete. 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e1400640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82e413f510 0x7f82e41dc6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d0001700 tx=0x7f82d0001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0001cf0 con 0x7f82e413f510 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d0018070 con 0x7f82e413f510 2024-04-26T22:21:28.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d000fc00 con 0x7f82e413f510 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 -- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2440b6ae0 msgr2=0x7fb244144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 --2- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2440b6ae0 0x7fb244144260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009870 tx=0x7fb23c01c580 comp rx=0 tx=0).stop 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 -- 172.21.15.16:0/2946293629 shutdown_connections 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 --2- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb24414cbb0 0x7fb24414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 --2- 172.21.15.16:0/2946293629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2440b6ae0 0x7fb244144260 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009870 tx=0x7fb23c01c580 comp rx=0 tx=0).stop 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 -- 172.21.15.16:0/2946293629 >> 172.21.15.16:0/2946293629 conn(0x7fb244068140 msgr2=0x7fb244068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 shutdown_connections 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1752341191 >> v2:172.21.15.195:3300/0 conn(0x7f5c740735d0 0x7f5c74150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1752341191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c740b6910 0x7f5c741462b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 >> 172.21.15.16:0/1752341191 conn(0x7f5c74068310 msgr2=0x7f5c74068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e413fbf0 con 0x7f82e413f510 2024-04-26T22:21:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e4144dc0 con 0x7f82e413f510 2024-04-26T22:21:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fc2dda00640 1 -- 172.21.15.16:0/3843254334 wait complete. 2024-04-26T22:21:28.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 832525176 0 0) 0x7f195c003530 con 0x7f19780b3bd0 2024-04-26T22:21:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1976a00640 1 -- 172.21.15.16:0/1376632019 >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 msgr2=0x7f1978150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82e40506d0 con 0x7f82e413f510 2024-04-26T22:21:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1976a00640 1 --2- 172.21.15.16:0/1376632019 >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 0x7f1978150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1976a00640 1 -- 172.21.15.16:0/1376632019 >> v1:172.21.15.195:6789/0 conn(0x7f19780b3bd0 legacy=0x7f1978149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f1976a00640 1 -- 172.21.15.16:0/1376632019 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19780b5ed0 con 0x7f197806e130 2024-04-26T22:21:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fec56400640 1 Processor -- start 2024-04-26T22:21:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 -- 172.21.15.16:0/2946293629 shutdown_connections 2024-04-26T22:21:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fb248e00640 1 -- 172.21.15.16:0/2946293629 wait complete. 2024-04-26T22:21:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 shutdown_connections 2024-04-26T22:21:28.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7f5c79c00640 1 -- 172.21.15.16:0/1752341191 wait complete. 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fc2dda00640 1 Processor -- start 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fec56400640 1 -- start start 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec5006d100 0x7fec500a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 0x7fec50148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501488b0 0x7fec500a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec50150e10 con 0x7fec501488b0 2024-04-26T22:21:28.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fec500b9520 con 0x7fec5006d100 2024-04-26T22:21:28.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fec50150f90 con 0x7fec500b7930 2024-04-26T22:21:28.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.296+0000 7fc2dda00640 1 -- start start 2024-04-26T22:21:28.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d8137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d8075c00 0x7fc2d8133e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b3680 0x7fc2d81e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d81459d0 con 0x7fc2d80b3680 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8145850 con 0x7fc2d8075780 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2dda00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d80b1df0 con 0x7fc2d8075c00 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 0x7fec50148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 0x7fec50148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41860/0 (socket says 172.21.15.16:41860) 2024-04-26T22:21:28.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 -- 172.21.15.16:0/3487175234 learned_addr learned my addr 172.21.15.16:0/3487175234 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d8137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d8137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57816/0 (socket says 172.21.15.16:57816) 2024-04-26T22:21:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 -- 172.21.15.16:0/3874746533 learned_addr learned my addr 172.21.15.16:0/3874746533 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4fe00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501488b0 0x7fec500a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fb248e00640 1 Processor -- start 2024-04-26T22:21:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f5c79c00640 1 Processor -- start 2024-04-26T22:21:28.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82d001d460 con 0x7f82e413f510 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 -- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec5006d100 msgr2=0x7fec500a55b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fec5006d100 0x7fec500a55b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 -- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501488b0 msgr2=0x7fec500a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501488b0 0x7fec500a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec501499d0 con 0x7fec500b7930 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec4ea00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 0x7fec50148370 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c480 tx=0x7fec3c00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fb248e00640 1 -- start start 2024-04-26T22:21:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f5c79c00640 1 -- start start 2024-04-26T22:21:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d7400640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b3680 0x7fc2d81e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c017070 con 0x7fec500b7930 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c005cf0 con 0x7fec500b7930 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f4a16000640 1 --2- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a180736d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a040097c0 tx=0x7f4a0401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1acde96d1e366af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c007290 con 0x7fec500b7930 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50148d10 con 0x7fec500b7930 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 -- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d8075c00 msgr2=0x7fc2d8133e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T22:21:28.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc2d8075c00 0x7fc2d8133e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 -- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b3680 msgr2=0x7fc2d81e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d80b3680 0x7fc2d81e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d8071e60 con 0x7fc2d8075780 2024-04-26T22:21:28.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec500a6ff0 con 0x7fec500b7930 2024-04-26T22:21:28.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f4a15600640 1 -- 172.21.15.16:0/2863165288 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b0070 con 0x7f4a180b25d0 2024-04-26T22:21:28.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f82c40683d0 0x7f82c406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f4a15600640 1 -- 172.21.15.16:0/2863165288 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a040ab600 con 0x7f4a180b25d0 2024-04-26T22:21:28.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f4a15600640 1 -- 172.21.15.16:0/2863165288 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040ab9d0 con 0x7f4a180b25d0 2024-04-26T22:21:28.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2d6a00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d8137450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0007dd0 tx=0x7fc2d000d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f82d0085e00 con 0x7f82e413f510 2024-04-26T22:21:28.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7f82c40705f0 0x7f82c4072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82c40730c0 con 0x7f82c40705f0 2024-04-26T22:21:28.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f82d008b060 con 0x7f82e413f510 2024-04-26T22:21:28.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d001a070 con 0x7fc2d8075780 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fb248e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 0x7fb2441420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7fb248e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24414cbb0 0x7fb2441e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c740735d0 0x7f5c741320d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec28001040 con 0x7fec500b7930 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f82e1e00640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f82c40683d0 0x7f82c406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f82e2800640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7f82c40705f0 0x7f82c4072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d0009e40 con 0x7fc2d8075780 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0015620 con 0x7fc2d8075780 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d8072140 con 0x7fc2d8075780 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d8072940 con 0x7fc2d8075780 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb243400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 0x7fb2441420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb243400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 0x7fb2441420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41618/0 (socket says 172.21.15.16:41618) 2024-04-26T22:21:28.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb243400640 1 -- 172.21.15.16:0/3194680127 learned_addr learned my addr 172.21.15.16:0/3194680127 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c740b6910 0x7f5c741df930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 0x7f5c7412fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c740b3d10 con 0x7f5c741467f0 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74073d10 con 0x7f5c740b6910 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5c740b3e90 con 0x7f5c740735d0 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f82e2800640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7f82c40705f0 0x7f82c4072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f82e1e00640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f82c40683d0 0x7f82c406a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0070b0 tx=0x7f82dc009870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f1977400640 1 --2- 172.21.15.16:0/1376632019 >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 0x7f1978150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb242a00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24414cbb0 0x7fb2441e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 0x7f5c7412fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 0x7f5c7412fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41634/0 (socket says 172.21.15.16:41634) 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c79200640 1 -- 172.21.15.16:0/1953189464 learned_addr learned my addr 172.21.15.16:0/1953189464 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73400640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c740b6910 0x7f5c741df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c740735d0 0x7f5c741320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 -- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 msgr2=0x7f4a180736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 --2- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a180736d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a040097c0 tx=0x7f4a0401c410 comp rx=0 tx=0).stop 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 -- 172.21.15.16:0/2863165288 shutdown_connections 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f53ffe00640 1 Processor -- start 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.300+0000 7f53ffe00640 1 -- start start 2024-04-26T22:21:28.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53ffe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f53f814c980 0x7f53f814d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 --2- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a180736d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 --2- 172.21.15.16:0/2863165288 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a180b6ae0 0x7f4a18144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 -- 172.21.15.16:0/2863165288 >> 172.21.15.16:0/2863165288 conn(0x7f4a18068140 msgr2=0x7f4a18068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2d8071c90 con 0x7fc2d8075780 2024-04-26T22:21:28.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53fd400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f53f806ec80 0x7f53f80b2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47438/0 (socket says 172.21.15.16:47438) 2024-04-26T22:21:28.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 -- 172.21.15.16:0/2863165288 shutdown_connections 2024-04-26T22:21:28.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53fd400640 1 -- 172.21.15.16:0/3603284171 learned_addr learned my addr 172.21.15.16:0/3603284171 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f4a17e00640 1 -- 172.21.15.16:0/2863165288 wait complete. 2024-04-26T22:21:28.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb248e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb244143270 0x7fb2441e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 -- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c740b6910 msgr2=0x7f5c741df930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c740b6910 0x7f5c741df930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 -- 172.21.15.16:0/1953189464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 msgr2=0x7f5c7412fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53fca00640 1 --2- 172.21.15.16:0/3603284171 >> v2:172.21.15.195:3300/0 conn(0x7f53f814c980 0x7f53f814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f1976a00640 1 --2- 172.21.15.16:0/1376632019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f197806e130 0x7f197814fee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19780b7660 tx=0x7f197001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5206c5dd30073c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440b3ec0 con 0x7fb2440b25d0 2024-04-26T22:21:28.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 0x7f5c7412fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fec3c01a070 con 0x7fec500b7930 2024-04-26T22:21:28.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f806f060 con 0x7f53f814d5b0 2024-04-26T22:21:28.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964001680 con 0x7f197806e130 2024-04-26T22:21:28.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440b3d40 con 0x7fb24414cbb0 2024-04-26T22:21:28.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb243e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb244143270 0x7fb2441e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== osd.0 v2:172.21.15.16:6800/3251041716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82c40730c0 con 0x7f82c40705f0 2024-04-26T22:21:28.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19700a64b0 con 0x7f197806e130 2024-04-26T22:21:28.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f1975600640 1 -- 172.21.15.16:0/1376632019 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964001680 con 0x7f197806e130 2024-04-26T22:21:28.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f80b3de0 con 0x7f53f806ec80 2024-04-26T22:21:28.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335826626 0 0) 0x7f53f806f060 con 0x7f53f814d5b0 2024-04-26T22:21:28.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440b0a30 con 0x7fb244143270 2024-04-26T22:21:28.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f5c73e00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c74139b90 con 0x7f5c740735d0 2024-04-26T22:21:28.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.304+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f53f80b3bb0 con 0x7f53f814c980 2024-04-26T22:21:28.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c79200640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c741467f0 0x7f5c7412fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c73e00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c740735d0 0x7f5c741320d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5c640ab000 tx=0x7f5c64019060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 -- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb244143270 msgr2=0x7fb2441e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 Processor -- start 2024-04-26T22:21:28.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 -- 172.21.15.16:0/1376632019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f197806e130 msgr2=0x7f197814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 --2- 172.21.15.16:0/1376632019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f197806e130 0x7f197814fee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19780b7660 tx=0x7f197001c870 comp rx=0 tx=0).stop 2024-04-26T22:21:28.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec47400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fec300683d0 0x7fec3006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec4f400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fec300683d0 0x7fec3006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb244143270 0x7fb2441e10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 -- 172.21.15.16:0/3194680127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 msgr2=0x7fb2441420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 -- start start 2024-04-26T22:21:28.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2d001d070 con 0x7fc2d8075780 2024-04-26T22:21:28.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fec3c085cc0 con 0x7fec500b7930 2024-04-26T22:21:28.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 -- 172.21.15.16:0/1376632019 shutdown_connections 2024-04-26T22:21:28.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 --2- 172.21.15.16:0/1376632019 >> v2:172.21.15.16:3300/0 conn(0x7f19780b1020 0x7f1978150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 --2- 172.21.15.16:0/1376632019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f197806e130 0x7f197814fee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 -- 172.21.15.16:0/1376632019 >> 172.21.15.16:0/1376632019 conn(0x7f19780b6620 msgr2=0x7f19780b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 0x7fb2441420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c640b9020 con 0x7f5c740735d0 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c640038a0 con 0x7f5c740735d0 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c640b0040 con 0x7f5c740735d0 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e0003530 con 0x7f53f814d5b0 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912437095 0 0) 0x7f53f80b3de0 con 0x7f53f806ec80 2024-04-26T22:21:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f806f060 con 0x7f53f806ec80 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244143780 con 0x7fb24414cbb0 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb243e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb244143270 0x7fb2441e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb243400640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2440b25d0 0x7fb2441420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c74139e70 con 0x7f5c740735d0 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c74138410 con 0x7f5c740735d0 2024-04-26T22:21:28.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec4f400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fec300683d0 0x7fec3006a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec480af000 tx=0x7fec480a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168032837 0 0) 0x7f53f806f060 con 0x7f53f806ec80 2024-04-26T22:21:28.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec47400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7fec30070650 0x7fec30072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec30073120 con 0x7fec30070650 2024-04-26T22:21:28.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fec3c089020 con 0x7fec500b7930 2024-04-26T22:21:28.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a18139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a180b6ae0 0x7f4a180b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a181477e0 0x7f4a1813fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb242a00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24414cbb0 0x7fb2441e0bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c3f0 tx=0x7fb23000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53fca00640 1 -- 172.21.15.16:0/3603284171 >> v1:172.21.15.195:6789/0 conn(0x7f53f806ec80 legacy=0x7f53f80b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 -- 172.21.15.16:0/1376632019 shutdown_connections 2024-04-26T22:21:28.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53fca00640 1 -- 172.21.15.16:0/3603284171 >> v1:172.21.15.16:6789/0 conn(0x7f53f814d5b0 legacy=0x7f53f8157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fec4fe00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7fec30070650 0x7fec30072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2300052d0 con 0x7fb24414cbb0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb230005470 con 0x7fb24414cbb0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230007260 con 0x7fb24414cbb0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb244143a60 con 0x7fb24414cbb0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24414c8f0 con 0x7fb24414cbb0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a18139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a18139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57862/0 (socket says 172.21.15.16:57862) 2024-04-26T22:21:28.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a16a00640 1 -- 172.21.15.16:0/914107467 learned_addr learned my addr 172.21.15.16:0/914107467 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180b0bb0 con 0x7f4a180b6ae0 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180b0a30 con 0x7f4a180b25d0 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4a18073c10 con 0x7f4a181477e0 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a17400640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a181477e0 0x7f4a1813fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f53fca00640 1 -- 172.21.15.16:0/3603284171 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f80b9670 con 0x7f53f814c980 2024-04-26T22:21:28.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7fc2cea00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc2b80683b0 0x7fc2b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f4a16000640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a180b6ae0 0x7f4a180b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f197da00640 1 -- 172.21.15.16:0/1376632019 wait complete. 2024-04-26T22:21:28.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb244148150 con 0x7fb24414cbb0 2024-04-26T22:21:28.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 -- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a181477e0 msgr2=0x7f4a1813fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4a181477e0 0x7f4a1813fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 -- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 msgr2=0x7f4a18139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a18139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1813a100 con 0x7f4a180b6ae0 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16a00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4a180b25d0 0x7f4a18139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2d6000640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc2b80683b0 0x7fc2b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.308+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c74138220 con 0x7f5c740735d0 2024-04-26T22:21:28.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2d0086800 con 0x7fc2d8075780 2024-04-26T22:21:28.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a16000640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a180b6ae0 0x7f4a180b95e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ab000 tx=0x7f4a040191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2d6000640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc2b80683b0 0x7fc2b806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ad000 tx=0x7fc2c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2cea00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fc2b80705b0 0x7fc2b80729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2b8073080 con 0x7fc2b80705b0 2024-04-26T22:21:28.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc2d008b2c0 con 0x7fc2d8075780 2024-04-26T22:21:28.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c640bc020 con 0x7f5c740735d0 2024-04-26T22:21:28.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b8020 con 0x7f4a180b6ae0 2024-04-26T22:21:28.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a040b4410 con 0x7f4a180b6ae0 2024-04-26T22:21:28.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a040b0040 con 0x7f4a180b6ae0 2024-04-26T22:21:28.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2d7400640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fc2b80705b0 0x7fc2b80729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f197da00640 1 Processor -- start 2024-04-26T22:21:28.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1813a3e0 con 0x7f4a180b6ae0 2024-04-26T22:21:28.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1813f420 con 0x7f4a180b6ae0 2024-04-26T22:21:28.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fc2d7400640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fc2b80705b0 0x7fc2b80729d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb230007400 con 0x7fb24414cbb0 2024-04-26T22:21:28.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f5c6be00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c54068450 0x7f5c5406a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49f0001040 con 0x7f4a180b6ae0 2024-04-26T22:21:28.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 -- start start 2024-04-26T22:21:28.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fec4fe00640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7fec30070650 0x7fec30072a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb23b400640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb2240683b0 0x7fb22406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.312+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5c64120580 con 0x7f5c740735d0 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c6be00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f5c540706d0 0x7f5c54072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c540731a0 con 0x7f5c540706d0 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5c64127050 con 0x7f5c740735d0 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c73400640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c54068450 0x7f5c5406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c79200640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f5c540706d0 0x7f5c54072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb230085de0 con 0x7fb24414cbb0 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb23b400640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7fb2240705d0 0x7fb2240729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb230014e50 con 0x7fb2240705d0 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb230088440 con 0x7fb24414cbb0 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c73400640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c54068450 0x7f5c5406a910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c74140260 tx=0x7f5c600016e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 0x7f1978070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 0x7f1978070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 0x7f1978070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41898/0 (socket says 172.21.15.16:41898) 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb243e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7fb2240705d0 0x7fb2240729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19780b1020 0x7f1978070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 -- 172.21.15.16:0/2937960524 learned_addr learned my addr 172.21.15.16:0/2937960524 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19780b3bd0 0x7f197813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== osd.3 v2:172.21.15.16:6824/700828209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec30073120 con 0x7fec30070650 2024-04-26T22:21:28.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb243400640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb2240683b0 0x7fb22406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f53fca00640 1 --2- 172.21.15.16:0/3603284171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814c980 0x7f53f814d070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097c0 tx=0x7f53e401c1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f3524ed3749c50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== osd.1 v2:172.21.15.16:6808/4148881658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2b8073080 con 0x7fc2b80705b0 2024-04-26T22:21:28.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1978157f90 con 0x7f19780b1020 2024-04-26T22:21:28.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1978157e10 con 0x7f19780b3bd0 2024-04-26T22:21:28.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1978158110 con 0x7f197806e130 2024-04-26T22:21:28.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1977400640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19780b3bd0 0x7f197813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb243e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7fb2240705d0 0x7fb2240729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f5c79200640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f5c540706d0 0x7f5c54072af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b0070 con 0x7f53f814c980 2024-04-26T22:21:28.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976000640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19780b1020 0x7f1978070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4a040bb020 con 0x7f4a180b6ae0 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e40ab400 con 0x7f53f814c980 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 -- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19780b3bd0 msgr2=0x7f197813bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19780b3bd0 0x7f197813bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 -- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19780b1020 msgr2=0x7f1978070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19780b1020 0x7f1978070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1978157190 con 0x7f197806e130 2024-04-26T22:21:28.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7fb243400640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb2240683b0 0x7fb22406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb23c01ac30 tx=0x7fb23c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f1976a00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 0x7f1978070880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f197001af20 tx=0x7f1970019610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== osd.5 v2:172.21.15.195:6800/228290065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c540731a0 con 0x7f5c540706d0 2024-04-26T22:21:28.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.316+0000 7f53f7e00640 1 -- 172.21.15.16:0/3603284171 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b0070 con 0x7f53f814c980 2024-04-26T22:21:28.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19700a6ca0 con 0x7f197806e130 2024-04-26T22:21:28.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19700a6e40 con 0x7f197806e130 2024-04-26T22:21:28.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970004040 con 0x7f197806e130 2024-04-26T22:21:28.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== osd.4 v2:172.21.15.195:6816/2204977921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb230014e50 con 0x7fb2240705d0 2024-04-26T22:21:28.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814c980 msgr2=0x7f53f814d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 --2- 172.21.15.16:0/3603284171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814c980 0x7f53f814d070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f53e40097c0 tx=0x7f53e401c1e0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a0ea00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f49f8068450 0x7f49f806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 shutdown_connections 2024-04-26T22:21:28.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 --2- 172.21.15.16:0/3603284171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814c980 0x7f53f814d070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 >> 172.21.15.16:0/3603284171 conn(0x7f53f80b7a20 msgr2=0x7f53f80b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a16a00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f49f8068450 0x7f49f806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4a04120840 con 0x7f4a180b6ae0 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a0ea00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f49f80706d0 0x7f49f8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a16a00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f49f8068450 0x7f49f806a910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006f50 tx=0x7f4a08009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a040bee50 con 0x7f49f80706d0 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f4a04120c30 con 0x7f4a180b6ae0 2024-04-26T22:21:28.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 shutdown_connections 2024-04-26T22:21:28.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f4a17400640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f49f80706d0 0x7f49f8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- 172.21.15.16:0/3603284171 wait complete. 2024-04-26T22:21:28.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 Processor -- start 2024-04-26T22:21:28.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197813e290 con 0x7f197806e130 2024-04-26T22:21:28.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f197813a5a0 con 0x7f197806e130 2024-04-26T22:21:28.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1978069450 con 0x7f197806e130 2024-04-26T22:21:28.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.320+0000 7f53ffe00640 1 -- start start 2024-04-26T22:21:28.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 0x7f53f8149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53f814c980 0x7f53f81ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814d5b0 0x7f53f81efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80b1250 con 0x7f53f814c980 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f53f815b780 con 0x7f53f814d5b0 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53ffe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f53f815b900 con 0x7f53f806ec80 2024-04-26T22:21:28.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19700c2020 con 0x7f197806e130 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fd400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 0x7f53f8149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fd400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 0x7f53f8149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41900/0 (socket says 172.21.15.16:41900) 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fd400640 1 -- 172.21.15.16:0/1428715924 learned_addr learned my addr 172.21.15.16:0/1428715924 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fde00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814d5b0 0x7f53f81efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53f814c980 0x7f53f81ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1958068480 0x7f195806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1970121740 con 0x7f197806e130 2024-04-26T22:21:28.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 -- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 msgr2=0x7f53f8149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f1976000640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1958068480 0x7f195806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7f1958070700 0x7f1958072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f197000ae60 con 0x7f1958070700 2024-04-26T22:21:28.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1970121b30 con 0x7f197806e130 2024-04-26T22:21:28.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 0x7f53f8149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 -- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814d5b0 msgr2=0x7f53f81efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814d5b0 0x7f53f81efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fca00640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f81e4030 con 0x7f53f814c980 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.324+0000 7f53fde00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53f814d5b0 0x7f53f81efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53fd400640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f53f806ec80 0x7f53f8149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f1977400640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7f1958070700 0x7f1958072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53fca00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53f814c980 0x7f53f81ef600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53e40ab000 tx=0x7f53e4018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f4a17400640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f49f80706d0 0x7f49f8072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f1976000640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1958068480 0x7f195806a940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1978149370 tx=0x7f1964009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b9020 con 0x7f53f814c980 2024-04-26T22:21:28.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e40038f0 con 0x7f53f814c980 2024-04-26T22:21:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b0040 con 0x7f53f814c980 2024-04-26T22:21:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53ffe00640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f81ee820 con 0x7f53f814c980 2024-04-26T22:21:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53ffe00640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f81e4450 con 0x7f53f814c980 2024-04-26T22:21:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f1977400640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7f1958070700 0x7f1958072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== osd.6 v2:172.21.15.195:6817/3327636089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a040bee50 con 0x7f49f80706d0 2024-04-26T22:21:28.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53ffe00640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53f81ee650 con 0x7f53f814c980 2024-04-26T22:21:28.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.328+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53e40bc020 con 0x7f53f814c980 2024-04-26T22:21:28.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== osd.2 v2:172.21.15.16:6816/3412985029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f197000ae60 con 0x7f1958070700 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53f5600640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f53d80683d0 0x7f53d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f53e4120290 con 0x7f53f814c980 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53f5600640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f53d8070650 0x7f53d8072a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53d8073120 con 0x7f53d8070650 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f53e4127050 con 0x7f53f814c980 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53fde00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f53d8070650 0x7f53d8072a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f53fd400640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f53d80683d0 0x7f53d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.332+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 --> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82e4145160 con 0x7f82c40705f0 2024-04-26T22:21:28.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f53fd400640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f53d80683d0 0x7f53d806a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53f0000f90 tx=0x7f53f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82da000640 1 -- 172.21.15.16:0/3930817971 <== osd.0 v2:172.21.15.16:6800/3251041716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82e4145160 con 0x7f82c40705f0 2024-04-26T22:21:28.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f53fde00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f53d8070650 0x7f53d8072a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7f82c40705f0 msgr2=0x7f82c4072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7f82c40705f0 0x7f82c4072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f82c40683d0 msgr2=0x7f82c406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f82c40683d0 0x7f82c406a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0070b0 tx=0x7f82dc009870 comp rx=0 tx=0).stop 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82e413f510 msgr2=0x7f82e41dc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e3200640 1 --2- 172.21.15.16:0/3930817971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82e413f510 0x7f82e41dc6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82d0001700 tx=0x7f82d0001bc0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f82e2800640 1 -- 172.21.15.16:0/3930817971 reap_dead start 2024-04-26T22:21:28.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.336+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== osd.7 v2:172.21.15.195:6808/4215805328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53d8073120 con 0x7f53d8070650 2024-04-26T22:21:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.340+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 shutdown_connections 2024-04-26T22:21:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.340+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 >> 172.21.15.16:0/3930817971 conn(0x7f82e4068310 msgr2=0x7f82e40b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.340+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 shutdown_connections 2024-04-26T22:21:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.340+0000 7f82e3200640 1 -- 172.21.15.16:0/3930817971 wait complete. 2024-04-26T22:21:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 --> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c740506d0 con 0x7f5c540706d0 2024-04-26T22:21:28.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 --> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec28002de0 con 0x7fec30070650 2024-04-26T22:21:28.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec47400640 1 -- 172.21.15.16:0/3487175234 <== osd.3 v2:172.21.15.16:6824/700828209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec28002de0 con 0x7fec30070650 2024-04-26T22:21:28.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c6be00640 1 -- 172.21.15.16:0/1953189464 <== osd.5 v2:172.21.15.195:6800/228290065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c740506d0 con 0x7f5c540706d0 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7fec30070650 msgr2=0x7fec30072a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7fec30070650 0x7fec30072a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fec300683d0 msgr2=0x7fec3006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f5c540706d0 msgr2=0x7f5c54072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f5c540706d0 0x7f5c54072af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c54068450 msgr2=0x7f5c5406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c54068450 0x7f5c5406a910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c74140260 tx=0x7f5c600016e0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c740735d0 msgr2=0x7f5c741320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79c00640 1 --2- 172.21.15.16:0/1953189464 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c740735d0 0x7f5c741320d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5c640ab000 tx=0x7f5c64019060 comp rx=0 tx=0).stop 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7f5c79200640 1 -- 172.21.15.16:0/1953189464 reap_dead start 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fec300683d0 0x7fec3006a890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec480af000 tx=0x7fec480a7070 comp rx=0 tx=0).stop 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.348+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 msgr2=0x7fec50148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec56400640 1 --2- 172.21.15.16:0/3487175234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fec500b7930 0x7fec50148370 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c480 tx=0x7fec3c00c940 comp rx=0 tx=0).stop 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec4fe00640 1 -- 172.21.15.16:0/3487175234 reap_dead start 2024-04-26T22:21:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 shutdown_connections 2024-04-26T22:21:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 >> 172.21.15.16:0/3487175234 conn(0x7fec500beda0 msgr2=0x7fec5006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 shutdown_connections 2024-04-26T22:21:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 >> 172.21.15.16:0/1953189464 conn(0x7f5c74068310 msgr2=0x7f5c740b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 shutdown_connections 2024-04-26T22:21:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 --> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2440506d0 con 0x7fb2240705d0 2024-04-26T22:21:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fec56400640 1 -- 172.21.15.16:0/3487175234 wait complete. 2024-04-26T22:21:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb23b400640 1 -- 172.21.15.16:0/3194680127 <== osd.4 v2:172.21.15.195:6816/2204977921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb2440506d0 con 0x7fb2240705d0 2024-04-26T22:21:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 shutdown_connections 2024-04-26T22:21:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7f5c79c00640 1 -- 172.21.15.16:0/1953189464 wait complete. 2024-04-26T22:21:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7fb2240705d0 msgr2=0x7fb2240729f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7fb2240705d0 0x7fb2240729f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb2240683b0 msgr2=0x7fb22406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb2240683b0 0x7fb22406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb23c01ac30 tx=0x7fb23c0a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:28.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24414cbb0 msgr2=0x7fb2441e0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 --2- 172.21.15.16:0/3194680127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb24414cbb0 0x7fb2441e0bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c3f0 tx=0x7fb23000c8b0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb243e00640 1 -- 172.21.15.16:0/3194680127 reap_dead start 2024-04-26T22:21:28.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 --> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2d8069b60 con 0x7fc2b80705b0 2024-04-26T22:21:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 shutdown_connections 2024-04-26T22:21:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 >> 172.21.15.16:0/3194680127 conn(0x7fb244068140 msgr2=0x7fb24413c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 shutdown_connections 2024-04-26T22:21:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fb248e00640 1 -- 172.21.15.16:0/3194680127 wait complete. 2024-04-26T22:21:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.352+0000 7fc2cea00640 1 -- 172.21.15.16:0/3874746533 <== osd.1 v2:172.21.15.16:6808/4148881658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc2d8069b60 con 0x7fc2b80705b0 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fc2b80705b0 msgr2=0x7fc2b80729d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fc2b80705b0 0x7fc2b80729d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc2b80683b0 msgr2=0x7fc2b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc2b80683b0 0x7fc2b806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ad000 tx=0x7fc2c80a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 msgr2=0x7fc2d8137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 --2- 172.21.15.16:0/3874746533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2d8075780 0x7fc2d8137450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0007dd0 tx=0x7fc2d000d4a0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2d7400640 1 -- 172.21.15.16:0/3874746533 reap_dead start 2024-04-26T22:21:28.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 shutdown_connections 2024-04-26T22:21:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 >> 172.21.15.16:0/3874746533 conn(0x7fc2d80ba2c0 msgr2=0x7fc2d80b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 shutdown_connections 2024-04-26T22:21:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.356+0000 7fc2dda00640 1 -- 172.21.15.16:0/3874746533 wait complete. 2024-04-26T22:21:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 --> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49f0002de0 con 0x7f49f80706d0 2024-04-26T22:21:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f53ffe00640 1 -- 172.21.15.16:0/1428715924 --> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53f8069450 con 0x7f53d8070650 2024-04-26T22:21:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f4a0ea00640 1 -- 172.21.15.16:0/914107467 <== osd.6 v2:172.21.15.195:6817/3327636089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49f0002de0 con 0x7f49f80706d0 2024-04-26T22:21:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f49f80706d0 msgr2=0x7f49f8072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f4a17e00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f49f80706d0 0x7f49f8072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 --> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1978072770 con 0x7f1958070700 2024-04-26T22:21:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f196ea00640 1 -- 172.21.15.16:0/2937960524 <== osd.2 v2:172.21.15.16:6816/3412985029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1978072770 con 0x7f1958070700 2024-04-26T22:21:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.360+0000 7f53f5600640 1 -- 172.21.15.16:0/1428715924 <== osd.7 v2:172.21.15.195:6808/4215805328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53f8069450 con 0x7f53d8070650 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f49f8068450 msgr2=0x7f49f806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f49f8068450 0x7f49f806a910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a08006f50 tx=0x7f4a08009240 comp rx=0 tx=0).stop 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a180b6ae0 msgr2=0x7f4a180b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 --2- 172.21.15.16:0/914107467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a180b6ae0 0x7f4a180b95e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a040ab000 tx=0x7f4a040191b0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17400640 1 -- 172.21.15.16:0/914107467 reap_dead start 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 shutdown_connections 2024-04-26T22:21:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 >> 172.21.15.16:0/914107467 conn(0x7f4a18068140 msgr2=0x7f4a1813e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f53d8070650 msgr2=0x7f53d8072a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f53d8070650 0x7f53d8072a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7f1958070700 msgr2=0x7f1958072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7f1958070700 0x7f1958072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f53d80683d0 msgr2=0x7f53d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f53d80683d0 0x7f53d806a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53f0000f90 tx=0x7f53f0009040 comp rx=0 tx=0).stop 2024-04-26T22:21:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53f814c980 msgr2=0x7f53f81ef600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53eaa00640 1 --2- 172.21.15.16:0/1428715924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53f814c980 0x7f53f81ef600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53e40ab000 tx=0x7f53e4018f80 comp rx=0 tx=0).stop 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f53fde00640 1 -- 172.21.15.16:0/1428715924 reap_dead start 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1958068480 msgr2=0x7f195806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1958068480 0x7f195806a940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1978149370 tx=0x7f1964009040 comp rx=0 tx=0).stop 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 msgr2=0x7f1978070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.364+0000 7f197da00640 1 --2- 172.21.15.16:0/2937960524 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f197806e130 0x7f1978070880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f197001af20 tx=0x7f1970019610 comp rx=0 tx=0).stop 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f1977400640 1 -- 172.21.15.16:0/2937960524 reap_dead start 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 shutdown_connections 2024-04-26T22:21:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 >> 172.21.15.16:0/2937960524 conn(0x7f19780b6620 msgr2=0x7f197813a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 shutdown_connections 2024-04-26T22:21:28.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 >> 172.21.15.16:0/1428715924 conn(0x7f53f80b7a20 msgr2=0x7f53f80b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 shutdown_connections 2024-04-26T22:21:28.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f197da00640 1 -- 172.21.15.16:0/2937960524 wait complete. 2024-04-26T22:21:28.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 shutdown_connections 2024-04-26T22:21:28.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f4a17e00640 1 -- 172.21.15.16:0/914107467 wait complete. 2024-04-26T22:21:28.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 shutdown_connections 2024-04-26T22:21:28.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.368+0000 7f53eaa00640 1 -- 172.21.15.16:0/1428715924 wait complete. 2024-04-26T22:21:28.401 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T22:21:28.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T22:21:28.402 INFO:teuthology.orchestra.run.smithi016.stdout:64424509448 2024-04-26T22:21:28.402 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T22:21:28.403 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:28.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T22:21:28.404 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:28.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T22:21:28.405 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:28.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T22:21:28.406 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:28.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T22:21:28.409 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:28.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T22:21:28.411 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:28.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T22:21:28.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 Processor -- start 2024-04-26T22:21:28.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 -- start start 2024-04-26T22:21:28.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 0x7f4c900356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4c900d9250 0x7f4c900db640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c90006890 con 0x7f4c90035be0 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4c90036d90 con 0x7f4c900064b0 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c9d400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4c900d4e40 con 0x7f4c900d9250 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c96800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 0x7f4c900356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c96800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 0x7f4c900356a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41674/0 (socket says 172.21.15.16:41674) 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c96800640 1 -- 172.21.15.16:0/527652368 learned_addr learned my addr 172.21.15.16:0/527652368 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.648+0000 7f4c97200640 1 --2- 172.21.15.16:0/527652368 >> v2:172.21.15.195:3300/0 conn(0x7f4c900d9250 0x7f4c900db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4c97200640 1 -- 172.21.15.16:0/527652368 >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 msgr2=0x7f4c900356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4c97200640 1 --2- 172.21.15.16:0/527652368 >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 0x7f4c900356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4c97200640 1 -- 172.21.15.16:0/527652368 >> v1:172.21.15.16:6789/0 conn(0x7f4c90035be0 legacy=0x7f4c900ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4c97200640 1 -- 172.21.15.16:0/527652368 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c900360b0 con 0x7f4c900d9250 2024-04-26T22:21:28.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4d4fe00640 1 Processor -- start 2024-04-26T22:21:28.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.652+0000 7f4d4fe00640 1 -- start start 2024-04-26T22:21:28.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4c97200640 1 --2- 172.21.15.16:0/527652368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c900d9250 0x7f4c900db640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000b70 tx=0x7f4c98098930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf69f3720c36c822 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4c95400640 1 -- 172.21.15.16:0/527652368 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c981266d0 con 0x7f4c900d9250 2024-04-26T22:21:28.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4c95400640 1 -- 172.21.15.16:0/527652368 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98126870 con 0x7f4c900d9250 2024-04-26T22:21:28.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4c95400640 1 -- 172.21.15.16:0/527652368 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98126c60 con 0x7f4c900d9250 2024-04-26T22:21:28.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 Processor -- start 2024-04-26T22:21:28.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d480bab70 0x7f4d480b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 -- start start 2024-04-26T22:21:28.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4fe00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4d480baf50 0x7f4d4813e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4fe00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d480b5ca0 con 0x7f4d480ba0e0 2024-04-26T22:21:28.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4fe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4d480b5250 con 0x7f4d480bab70 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4fe00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4d480b7b50 con 0x7f4d480baf50 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4ca00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4d480ba0e0 0x7f4d4814b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47450/0 (socket says 172.21.15.16:47450) 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4ca00640 1 -- 172.21.15.16:0/843664783 learned_addr learned my addr 172.21.15.16:0/843664783 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4de00640 1 --2- 172.21.15.16:0/843664783 >> v2:172.21.15.195:3300/0 conn(0x7f4d480baf50 0x7f4d4813e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4d400640 1 --2- 172.21.15.16:0/843664783 >> v2:172.21.15.16:3300/0 conn(0x7f4d480bab70 0x7f4d480b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4de00640 1 -- 172.21.15.16:0/843664783 >> v2:172.21.15.16:3300/0 conn(0x7f4d480bab70 msgr2=0x7f4d480b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4de00640 1 --2- 172.21.15.16:0/843664783 >> v2:172.21.15.16:3300/0 conn(0x7f4d480bab70 0x7f4d480b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4de00640 1 -- 172.21.15.16:0/843664783 >> v1:172.21.15.195:6789/0 conn(0x7f4d480ba0e0 legacy=0x7f4d4814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7f4d4de00640 1 -- 172.21.15.16:0/843664783 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480b54a0 con 0x7f4d480baf50 2024-04-26T22:21:28.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff92c142920 0x7ff92c0a0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c09cb80 con 0x7ff92c09bed0 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff92c09d1d0 con 0x7ff92c142920 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff933600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c09ce60 con 0x7ff92c0bd5a0 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff930c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff92c142920 0x7ff92c0a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff92be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff92c09bed0 0x7ff92c0bce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59480/0 (socket says 172.21.15.16:59480) 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff92be00640 1 -- 172.21.15.16:0/1479185117 learned_addr learned my addr 172.21.15.16:0/1479185117 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.656+0000 7ff931600640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7ff930c00640 1 -- 172.21.15.16:0/1479185117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 msgr2=0x7ff92c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7ff930c00640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7ff930c00640 1 -- 172.21.15.16:0/1479185117 >> v1:172.21.15.16:6789/0 conn(0x7ff92c09bed0 legacy=0x7ff92c0bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7ff930c00640 1 -- 172.21.15.16:0/1479185117 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c0bbd10 con 0x7ff92c142920 2024-04-26T22:21:28.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7fcbf8000640 1 Processor -- start 2024-04-26T22:21:28.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7f4c9d400640 1 -- 172.21.15.16:0/527652368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c900d9250 msgr2=0x7f4c900db640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7f4c9d400640 1 --2- 172.21.15.16:0/527652368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c900d9250 0x7f4c900db640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000b70 tx=0x7f4c98098930 comp rx=0 tx=0).stop 2024-04-26T22:21:28.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4de00640 1 --2- 172.21.15.16:0/843664783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480baf50 0x7f4d4813e9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d480b6c80 tx=0x7f4d4001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ad9d5573b5a2c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.660+0000 7fcbf8000640 1 -- start start 2024-04-26T22:21:28.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 -- 172.21.15.16:0/527652368 shutdown_connections 2024-04-26T22:21:28.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 --2- 172.21.15.16:0/527652368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c900d9250 0x7f4c900db640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 --2- 172.21.15.16:0/527652368 >> v2:172.21.15.16:3300/0 conn(0x7f4c900064b0 0x7f4c900356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 -- 172.21.15.16:0/527652368 >> 172.21.15.16:0/527652368 conn(0x7f4c9003b120 msgr2=0x7f4c9003b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d47e00640 1 -- 172.21.15.16:0/843664783 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400b2070 con 0x7f4d480baf50 2024-04-26T22:21:28.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d47e00640 1 -- 172.21.15.16:0/843664783 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d400a5840 con 0x7f4d480baf50 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d47e00640 1 -- 172.21.15.16:0/843664783 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400a5c10 con 0x7f4d480baf50 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 -- 172.21.15.16:0/843664783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480baf50 msgr2=0x7f4d4813e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/843664783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480baf50 0x7f4d4813e9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d480b6c80 tx=0x7f4d4001c870 comp rx=0 tx=0).stop 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 -- 172.21.15.16:0/843664783 shutdown_connections 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/843664783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480baf50 0x7f4d4813e9b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/843664783 >> v2:172.21.15.16:3300/0 conn(0x7f4d480bab70 0x7f4d480b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 -- 172.21.15.16:0/843664783 >> 172.21.15.16:0/843664783 conn(0x7f4d48068540 msgr2=0x7f4d48068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf01452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf8000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf8000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf0071690 con 0x7fcbf00b19f0 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf8000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf006ea20 con 0x7fcbf013f7e0 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf006f2c0 con 0x7fcbf00b66b0 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 -- 172.21.15.16:0/527652368 shutdown_connections 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7ff930c00640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0a0190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff92001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54aeb421e0aed54a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7ff92b400640 1 -- 172.21.15.16:0/1479185117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9200b2070 con 0x7ff92c142920 2024-04-26T22:21:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf01452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7ff92b400640 1 -- 172.21.15.16:0/1479185117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9200a5710 con 0x7ff92c142920 2024-04-26T22:21:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7ff92b400640 1 -- 172.21.15.16:0/1479185117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9200a5ae0 con 0x7ff92c142920 2024-04-26T22:21:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 -- 172.21.15.16:0/527652368 wait complete. 2024-04-26T22:21:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf6000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf6000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57908/0 (socket says 172.21.15.16:57908) 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf6000640 1 -- 172.21.15.16:0/3002430248 learned_addr learned my addr 172.21.15.16:0/3002430248 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 -- 172.21.15.16:0/843664783 shutdown_connections 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4d4fe00640 1 -- 172.21.15.16:0/843664783 wait complete. 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 Processor -- start 2024-04-26T22:21:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7f4c9d400640 1 -- start start 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf5600640 1 -- 172.21.15.16:0/3002430248 >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 msgr2=0x7fcbf0145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf5600640 1 --2- 172.21.15.16:0/3002430248 >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf5600640 1 -- 172.21.15.16:0/3002430248 >> v1:172.21.15.195:6789/0 conn(0x7fcbf00b19f0 legacy=0x7fcbf013f0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.664+0000 7fcbf5600640 1 -- 172.21.15.16:0/3002430248 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00b6a90 con 0x7fcbf00b66b0 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c900064b0 0x7f4c900c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 0x7f4c90171c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 0x7f4c90172170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900386e0 con 0x7f4c900064b0 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90038560 con 0x7f4c90035be0 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c90036590 con 0x7f4c900d9250 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7fcbf6000640 1 --2- 172.21.15.16:0/3002430248 >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c95e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 0x7f4c90171c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c95e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 0x7f4c90171c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57910/0 (socket says 172.21.15.16:57910) 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c95e00640 1 -- 172.21.15.16:0/3665202800 learned_addr learned my addr 172.21.15.16:0/3665202800 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 0x7f4c90172170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 -- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 msgr2=0x7f4c90171c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 0x7f4c90171c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 -- 172.21.15.16:0/3665202800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c900064b0 msgr2=0x7f4c900c9db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c900064b0 0x7f4c900c9db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 -- 172.21.15.16:0/3665202800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c900d7750 con 0x7f4c900d9250 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 Processor -- start 2024-04-26T22:21:28.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 -- start start 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 -- 172.21.15.16:0/1479185117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 msgr2=0x7ff92c0a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0a0190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff920009d90 tx=0x7ff92001c870 comp rx=0 tx=0).stop 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c97200640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 0x7f4c90172170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4c98051520 tx=0x7f4c9806c1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50880737f0 0x7f50880b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5088073bd0 0x7f5088147910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50880b1c30 con 0x7f5088147e50 2024-04-26T22:21:28.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f50880b2710 con 0x7f50880737f0 2024-04-26T22:21:28.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5087e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50880b2280 con 0x7f5088073bd0 2024-04-26T22:21:28.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 Processor -- start 2024-04-26T22:21:28.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50880737f0 0x7f50880b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7fbf32000640 1 Processor -- start 2024-04-26T22:21:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50880737f0 0x7f50880b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41686/0 (socket says 172.21.15.16:41686) 2024-04-26T22:21:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 -- start start 2024-04-26T22:21:28.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 -- 172.21.15.16:0/943472849 learned_addr learned my addr 172.21.15.16:0/943472849 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7fbf32000640 1 -- start start 2024-04-26T22:21:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 -- 172.21.15.16:0/943472849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5088073bd0 msgr2=0x7f5088147910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T22:21:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 --2- 172.21.15.16:0/943472849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5088073bd0 0x7f5088147910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5086a00640 1 -- 172.21.15.16:0/943472849 >> v1:172.21.15.195:6789/0 conn(0x7f5088147e50 legacy=0x7f50880b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98135070 con 0x7f4c900d9250 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98131850 con 0x7f4c900d9250 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98131c00 con 0x7f4c900d9250 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c900d5060 con 0x7f4c900d9250 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 -- 172.21.15.16:0/1479185117 shutdown_connections 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 --2- 172.21.15.16:0/1479185117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0a0190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7ff933600640 1 -- 172.21.15.16:0/1479185117 >> 172.21.15.16:0/1479185117 conn(0x7ff92c068850 msgr2=0x7ff92c09fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 0x7f4d48141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 0x7f4d481e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 0x7f4d481e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48155840 con 0x7f4d480baf50 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481556c0 con 0x7f4d480bab70 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f4d4fe00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d481559c0 con 0x7f4d480ba0e0 2024-04-26T22:21:28.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c900d7470 con 0x7f4c900d9250 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.668+0000 7f5085600640 1 -- 172.21.15.16:0/943472849 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503956092 0 0) 0x7f50880b1c30 con 0x7f5088147e50 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f5086a00640 1 -- 172.21.15.16:0/943472849 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50880b1f10 con 0x7f50880737f0 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7ff933600640 1 -- 172.21.15.16:0/1479185117 shutdown_connections 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7ff933600640 1 -- 172.21.15.16:0/1479185117 wait complete. 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 0x7f4d481e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 0x7f4d481e8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57914/0 (socket says 172.21.15.16:57914) 2024-04-26T22:21:28.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4ca00640 1 -- 172.21.15.16:0/3971208281 learned_addr learned my addr 172.21.15.16:0/3971208281 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf32000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf2c068c60 0x7fbf2c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf32000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c0736d0 0x7fbf2c148b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf32000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2c0b1220 con 0x7fbf2c0b25d0 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf32000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2c0b15d0 con 0x7fbf2c068c60 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf32000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c0b5da0 con 0x7fbf2c0736d0 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 0x7f4d48141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4de00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 0x7f4d481e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c900057f0 con 0x7f4c900d9250 2024-04-26T22:21:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf2c068c60 0x7fbf2c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 -- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 msgr2=0x7f4d481e8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 0x7f4d481e8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 -- 172.21.15.16:0/3971208281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 msgr2=0x7f4d481e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbf2c068c60 0x7fbf2c0b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57916/0 (socket says 172.21.15.16:57916) 2024-04-26T22:21:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 -- 172.21.15.16:0/420176714 learned_addr learned my addr 172.21.15.16:0/420176714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf31600640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c0736d0 0x7fbf2c148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fcbf5600640 1 --2- 172.21.15.16:0/3002430248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf01452c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097c0 tx=0x7fcbdc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc16a5ee95b2173 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 -- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c0736d0 msgr2=0x7fbf2c148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c0736d0 0x7fbf2c148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 -- 172.21.15.16:0/420176714 >> v1:172.21.15.195:6789/0 conn(0x7fbf2c0b25d0 legacy=0x7fbf2c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fbf30c00640 1 -- 172.21.15.16:0/420176714 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c0b6dc0 con 0x7fbf2c068c60 2024-04-26T22:21:28.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4e3f200640 1 Processor -- start 2024-04-26T22:21:28.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c98138070 con 0x7f4c900d9250 2024-04-26T22:21:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fcbefe00640 1 -- 172.21.15.16:0/3002430248 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0b0070 con 0x7fcbf00b66b0 2024-04-26T22:21:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fcbefe00640 1 -- 172.21.15.16:0/3002430248 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0ab600 con 0x7fcbf00b66b0 2024-04-26T22:21:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7fcbefe00640 1 -- 172.21.15.16:0/3002430248 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0ab9d0 con 0x7fcbf00b66b0 2024-04-26T22:21:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 0x7f4d481e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4d400640 1 -- 172.21.15.16:0/3971208281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d48141070 con 0x7f4d480ba0e0 2024-04-26T22:21:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7ff933600640 1 Processor -- start 2024-04-26T22:21:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7ff933600640 1 -- start start 2024-04-26T22:21:28.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4d4de00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 0x7f4d481e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 -- 172.21.15.16:0/3002430248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 msgr2=0x7fcbf01452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 --2- 172.21.15.16:0/3002430248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf01452c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097c0 tx=0x7fcbdc01c480 comp rx=0 tx=0).stop 2024-04-26T22:21:28.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.672+0000 7f4e3f200640 1 -- start start 2024-04-26T22:21:28.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4d4d400640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 0x7f4d48141ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c7f0 tx=0x7f4d3400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4c8ea00640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 0x7f4c7806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c9819cad0 con 0x7f4c900d9250 2024-04-26T22:21:28.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e3f200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e38142920 0x7f4e380a0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e3f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e380bce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e3f200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e380bd860 con 0x7f4e380bd3d0 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e3f200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3809d1d0 con 0x7f4e38142920 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e3f200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3809cb80 con 0x7f4e3809bed0 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e38142920 0x7f4e380a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4e38142920 0x7f4e380a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57920/0 (socket says 172.21.15.16:57920) 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 -- 172.21.15.16:0/3441999054 learned_addr learned my addr 172.21.15.16:0/3441999054 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f8a54600640 1 Processor -- start 2024-04-26T22:21:28.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c0ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0ba550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37400640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e380bce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 -- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 msgr2=0x7f4e380bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e380bce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 -- 172.21.15.16:0/3441999054 >> v1:172.21.15.195:6789/0 conn(0x7f4e380bd3d0 legacy=0x7f4e3814ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c155ce0 con 0x7ff92c142920 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c155b60 con 0x7ff92c09bed0 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff933600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c155e60 con 0x7ff92c0bd5a0 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f8a54600640 1 -- start start 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4c96800640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 0x7f4c7806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f4e37e00640 1 -- 172.21.15.16:0/3441999054 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3809ce60 con 0x7f4e38142920 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0ba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff930c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff92be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c0ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff930c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57922/0 (socket says 172.21.15.16:57922) 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff930c00640 1 -- 172.21.15.16:0/774875887 learned_addr learned my addr 172.21.15.16:0/774875887 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f5086a00640 1 --2- 172.21.15.16:0/943472849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880737f0 0x7f50880b6800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5080009e50 tx=0x7f508001daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb87b5914727102c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 -- 172.21.15.16:0/3002430248 shutdown_connections 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 --2- 172.21.15.16:0/3002430248 >> v2:172.21.15.195:3300/0 conn(0x7fcbf013f7e0 0x7fcbf0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 --2- 172.21.15.16:0/3002430248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf01452c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 -- 172.21.15.16:0/3002430248 >> 172.21.15.16:0/3002430248 conn(0x7fcbf006c400 msgr2=0x7fcbf006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 -- 172.21.15.16:0/3002430248 shutdown_connections 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7fcbf8000640 1 -- 172.21.15.16:0/3002430248 wait complete. 2024-04-26T22:21:28.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f5085600640 1 -- 172.21.15.16:0/943472849 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800a67d0 con 0x7f50880737f0 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 -- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 msgr2=0x7ff92c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c0ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 -- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 msgr2=0x7ff92c0bb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff931600640 1 -- 172.21.15.16:0/774875887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c0b8820 con 0x7ff92c142920 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7ff930c00640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:28.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f5085600640 1 -- 172.21.15.16:0/943472849 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50800a6970 con 0x7f50880737f0 2024-04-26T22:21:28.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.676+0000 7f5085600640 1 -- 172.21.15.16:0/943472849 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800a67d0 con 0x7f50880737f0 2024-04-26T22:21:28.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f4c96800640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 0x7f4c7806a890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c9016f4a0 tx=0x7f4c88009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff931600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0ba550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d560 tx=0x7ff92400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9240125f0 con 0x7ff92c142920 2024-04-26T22:21:28.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924019070 con 0x7ff92c142920 2024-04-26T22:21:28.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9240129d0 con 0x7ff92c142920 2024-04-26T22:21:28.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- 172.21.15.16:0/943472849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880737f0 msgr2=0x7f50880b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 --2- 172.21.15.16:0/943472849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880737f0 0x7f50880b6800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5080009e50 tx=0x7f508001daf0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c0b7f20 con 0x7ff92c142920 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a54600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8a4c073790 0x7f8a4c144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a54600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a54600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0b0940 con 0x7f8a4c0b1a90 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a54600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4c0b1f20 con 0x7f8a4c073790 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a54600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0b06f0 con 0x7f8a4c0b3a70 2024-04-26T22:21:28.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c14bc30 con 0x7ff92c142920 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 Processor -- start 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 -- start start 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fbf30c00640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c068c60 0x7fbf2c0b6880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009870 tx=0x7fbf2001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65ecb5a3978dfeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- 172.21.15.16:0/943472849 shutdown_connections 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 --2- 172.21.15.16:0/943472849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5088073bd0 0x7f5088147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 --2- 172.21.15.16:0/943472849 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880737f0 0x7f50880b6800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- 172.21.15.16:0/943472849 >> 172.21.15.16:0/943472849 conn(0x7f5088068310 msgr2=0x7f5088068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- 172.21.15.16:0/943472849 shutdown_connections 2024-04-26T22:21:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- 172.21.15.16:0/943472849 wait complete. 2024-04-26T22:21:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8a4c073790 0x7f8a4c144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8a4c073790 0x7f8a4c144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57936/0 (socket says 172.21.15.16:57936) 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 0x7fcbf00b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf00722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf013f7e0 0x7fcbf00727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0068d20 con 0x7fcbf013f7e0 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0068ba0 con 0x7fcbf00b19f0 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf8000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf0068ea0 con 0x7fcbf00b66b0 2024-04-26T22:21:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a52600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8a4c0b1a90 0x7f8a4c1478a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59484/0 (socket says 172.21.15.16:59484) 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a52600640 1 -- 172.21.15.16:0/2619565527 learned_addr learned my addr 172.21.15.16:0/2619565527 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51200640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fbf2b400640 1 -- 172.21.15.16:0/420176714 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b5070 con 0x7fbf2c068c60 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fbf2b400640 1 -- 172.21.15.16:0/420176714 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200a89d0 con 0x7fbf2c068c60 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fbf2b400640 1 -- 172.21.15.16:0/420176714 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200a8da0 con 0x7fbf2c068c60 2024-04-26T22:21:28.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c069450 con 0x7ff92c142920 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 0x7fcbf00b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 0x7fcbf00b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57946/0 (socket says 172.21.15.16:57946) 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf5600640 1 -- 172.21.15.16:0/1232813859 learned_addr learned my addr 172.21.15.16:0/1232813859 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf00722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 Processor -- start 2024-04-26T22:21:28.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f5087e00640 1 -- start start 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 -- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 msgr2=0x7fcbf00b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 0x7fcbf00b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 -- 172.21.15.16:0/1232813859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf013f7e0 msgr2=0x7fcbf00727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf013f7e0 0x7fcbf00727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7fcbf4c00640 1 -- 172.21.15.16:0/1232813859 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf013a240 con 0x7fcbf00b66b0 2024-04-26T22:21:28.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbf4c00640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf00722b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b410 tx=0x7fcbe400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 0x7f508813a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 0x7f50881deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5086a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 0x7f508813a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5086a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 0x7f508813a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:41994/0 (socket says 172.21.15.16:41994) 2024-04-26T22:21:28.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5086a00640 1 -- 172.21.15.16:0/2685348922 learned_addr learned my addr 172.21.15.16:0/2685348922 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c98123070 con 0x7f4c900d9250 2024-04-26T22:21:28.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5086000640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 0x7f50881deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4015020 con 0x7fcbf00b66b0 2024-04-26T22:21:28.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff924012b70 con 0x7ff92c142920 2024-04-26T22:21:28.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe4011830 con 0x7fcbf00b66b0 2024-04-26T22:21:28.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4011c20 con 0x7fcbf00b66b0 2024-04-26T22:21:28.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf0073cf0 con 0x7fcbf00b66b0 2024-04-26T22:21:28.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5088147e50 0x7f50881df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7ff928c00640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 0x7ff90c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff9240875f0 con 0x7ff92c142920 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34015070 con 0x7f4d480ba0e0 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d34004220 con 0x7f4d480ba0e0 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003620 con 0x7f4d480ba0e0 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d48142320 con 0x7f4d480ba0e0 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d480bd780 con 0x7f4d480ba0e0 2024-04-26T22:21:28.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d480506d0 con 0x7f4d480ba0e0 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf00b4070 con 0x7fcbf00b66b0 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 -- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 msgr2=0x7f8a4c0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 -- 172.21.15.16:0/2619565527 >> v1:172.21.15.16:6789/0 conn(0x7f8a4c0b1a90 legacy=0x7f8a4c1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a51c00640 1 -- 172.21.15.16:0/2619565527 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c144c80 con 0x7f8a4c073790 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.680+0000 7f8a4be00640 1 -- 172.21.15.16:0/2619565527 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312272373 0 0) 0x7f8a4c0b0940 con 0x7f8a4c0b1a90 2024-04-26T22:21:28.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e37e00640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e38142920 0x7f4e380a0190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009870 tx=0x7f4e2401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eae8f8151e5731e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e36a00640 1 -- 172.21.15.16:0/3441999054 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240b0070 con 0x7f4e38142920 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e36a00640 1 -- 172.21.15.16:0/3441999054 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e240ab600 con 0x7f4e38142920 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e36a00640 1 -- 172.21.15.16:0/3441999054 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240ab9d0 con 0x7f4e38142920 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 -- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e38142920 msgr2=0x7f4e380a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e38142920 0x7f4e380a0190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009870 tx=0x7f4e2401c400 comp rx=0 tx=0).stop 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 -- 172.21.15.16:0/3441999054 shutdown_connections 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e380bce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3441999054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e38142920 0x7f4e380a0190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f4e3f200640 1 -- 172.21.15.16:0/3441999054 >> 172.21.15.16:0/3441999054 conn(0x7f4e38068850 msgr2=0x7f4e3809fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f50880b5ed0 con 0x7f5088147e50 2024-04-26T22:21:28.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f50880b5d50 con 0x7f5088073bd0 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f50880b3c70 con 0x7f50880737f0 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7ff930c00640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 0x7ff90c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a51c00640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c073790 0x7f8a4c144310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000dbe0 tx=0x7f8a40020740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b06df67ac4ecf2b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 -- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 msgr2=0x7f508813a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 0x7f508813a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 -- 172.21.15.16:0/2685348922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5088147e50 msgr2=0x7f50881df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5088147e50 0x7f50881df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508813b740 con 0x7f5088073bd0 2024-04-26T22:21:28.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fbf32000640 1 -- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c068c60 msgr2=0x7fbf2c0b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4e3f200640 1 -- 172.21.15.16:0/3441999054 shutdown_connections 2024-04-26T22:21:28.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.684+0000 7fbf32000640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c068c60 0x7fbf2c0b6880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009870 tx=0x7fbf2001ed10 comp rx=0 tx=0).stop 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4e3f200640 1 -- 172.21.15.16:0/3441999054 wait complete. 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 -- 172.21.15.16:0/420176714 shutdown_connections 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c0736d0 0x7fbf2c148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 --2- 172.21.15.16:0/420176714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c068c60 0x7fbf2c0b6880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 -- 172.21.15.16:0/420176714 >> 172.21.15.16:0/420176714 conn(0x7fbf2c068140 msgr2=0x7fbf2c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcbe4018020 con 0x7fcbf00b66b0 2024-04-26T22:21:28.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf0069450 con 0x7fcbf00b66b0 2024-04-26T22:21:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7ff930c00640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 0x7ff90c06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff92001af20 tx=0x7ff9200a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d340037c0 con 0x7f4d480ba0e0 2024-04-26T22:21:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 -- 172.21.15.16:0/420176714 shutdown_connections 2024-04-26T22:21:28.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a4be00640 1 -- 172.21.15.16:0/2619565527 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b0070 con 0x7f8a4c073790 2024-04-26T22:21:28.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 -- 172.21.15.16:0/420176714 wait complete. 2024-04-26T22:21:28.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a4be00640 1 -- 172.21.15.16:0/2619565527 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a400ac460 con 0x7f8a4c073790 2024-04-26T22:21:28.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a4be00640 1 -- 172.21.15.16:0/2619565527 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000d2d0 con 0x7f8a4c073790 2024-04-26T22:21:28.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbed600640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 0x7fcbd006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcbe4086710 con 0x7fcbf00b66b0 2024-04-26T22:21:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbf5600640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 0x7fcbd006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 -- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c073790 msgr2=0x7f8a4c144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c073790 0x7f8a4c144310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000dbe0 tx=0x7f8a40020740 comp rx=0 tx=0).stop 2024-04-26T22:21:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5086000640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 0x7f50881deaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f507800b3f0 tx=0x7f507800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4d45600640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 0x7f4d2806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 -- 172.21.15.16:0/2619565527 shutdown_connections 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 --2- 172.21.15.16:0/2619565527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c073790 0x7f8a4c144310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 -- 172.21.15.16:0/2619565527 >> 172.21.15.16:0/2619565527 conn(0x7f8a4c0b62e0 msgr2=0x7f8a4c0b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:28.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4d340866a0 con 0x7f4d480ba0e0 2024-04-26T22:21:28.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4d4ca00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 0x7f4d2806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fcbf5600640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 0x7fcbd006a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097c0 tx=0x7fcbdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 -- 172.21.15.16:0/2619565527 shutdown_connections 2024-04-26T22:21:28.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507801d070 con 0x7f5088073bd0 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f8a54600640 1 -- 172.21.15.16:0/2619565527 wait complete. 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5078010a50 con 0x7f5088073bd0 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078010e40 con 0x7f5088073bd0 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508813ba20 con 0x7f5088073bd0 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508813c330 con 0x7f5088073bd0 2024-04-26T22:21:28.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7f4d4ca00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 0x7f4d2806a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d4814aa00 tx=0x7f4d3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 Processor -- start 2024-04-26T22:21:28.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 Processor -- start 2024-04-26T22:21:28.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.688+0000 7fbf32000640 1 -- start start 2024-04-26T22:21:28.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 -- start start 2024-04-26T22:21:28.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c0736d0 0x7fbf2c140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508813c760 con 0x7f5088073bd0 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf2c0b25d0 0x7fbf2c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c0b0bb0 con 0x7fbf2c0b25d0 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c0b0a30 con 0x7fbf2c0736d0 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf32000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2c073b20 con 0x7fbf2c068c60 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42010/0 (socket says 172.21.15.16:42010) 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 -- 172.21.15.16:0/1824522906 learned_addr learned my addr 172.21.15.16:0/1824522906 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf2be00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c0736d0 0x7fbf2c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 -- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c0736d0 msgr2=0x7fbf2c140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c0736d0 0x7fbf2c140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 -- 172.21.15.16:0/1824522906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf2c0b25d0 msgr2=0x7fbf2c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf2c0b25d0 0x7fbf2c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 -- 172.21.15.16:0/1824522906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1e62d0 con 0x7fbf2c068c60 2024-04-26T22:21:28.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7fbf30c00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf200b3040 tx=0x7fbf2001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 0x7f4e3814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 0x7f4e38146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e37e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42018/0 (socket says 172.21.15.16:42018) 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e37400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 0x7f4e3814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e37400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 0x7f4e3814b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:57970/0 (socket says 172.21.15.16:57970) 2024-04-26T22:21:28.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f8a54600640 1 Processor -- start 2024-04-26T22:21:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 0x7f4e38146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 0x7f4e38146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41734/0 (socket says 172.21.15.16:41734) 2024-04-26T22:21:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3809c590 con 0x7f4e38142920 2024-04-26T22:21:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e37e00640 1 -- 172.21.15.16:0/3610905551 learned_addr learned my addr 172.21.15.16:0/3610905551 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3809c410 con 0x7f4e380bd3d0 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f8a54600640 1 -- start start 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.692+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4e38155e20 con 0x7f4e3809bed0 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 -- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 msgr2=0x7f4e3814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 0x7f4e3814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 -- 172.21.15.16:0/3610905551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 msgr2=0x7f4e38146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 0x7f4e38146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4d34056680 con 0x7f4d480ba0e0 2024-04-26T22:21:28.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e380ba8c0 con 0x7f4e3809bed0 2024-04-26T22:21:28.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e37e00640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ae040 tx=0x7f4e2401ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 0x7f8a4c0b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff92c0b8820 con 0x7ff92c142920 2024-04-26T22:21:28.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5078004020 con 0x7f5088073bd0 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1449d0 con 0x7f8a4c073790 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c144850 con 0x7f8a4c0b1a90 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a54600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c151c50 con 0x7f8a4c0b3a70 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 0x7f8a4c0b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41746/0 (socket says 172.21.15.16:41746) 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 -- 172.21.15.16:0/1135216487 learned_addr learned my addr 172.21.15.16:0/1135216487 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a52600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 -- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 msgr2=0x7f8a4c0b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 -- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 msgr2=0x7f8a4c0b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f507ea00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 0x7f506806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 0x7f8a4c0b9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 -- 172.21.15.16:0/1135216487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0b9a70 con 0x7f8a4c073790 2024-04-26T22:21:28.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51200640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 0x7f8a4c0b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240ba020 con 0x7f4e3809bed0 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e240b6420 con 0x7f4e3809bed0 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240b0040 con 0x7f4e3809bed0 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b5070 con 0x7fbf2c068c60 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf200b0a70 con 0x7fbf2c068c60 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b0e60 con 0x7fbf2c068c60 2024-04-26T22:21:28.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fbf32000640 1 -- 172.21.15.16:0/1824522906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c1e65b0 con 0x7fbf2c068c60 2024-04-26T22:21:28.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f50780863c0 con 0x7f5088073bd0 2024-04-26T22:21:28.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f5086a00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 0x7f506806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f8a51c00640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000dbe0 tx=0x7f8a4001d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e38147410 con 0x7f4e3809bed0 2024-04-26T22:21:28.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e380bae40 con 0x7f4e3809bed0 2024-04-26T22:21:28.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcbe401f020 con 0x7fcbf00b66b0 2024-04-26T22:21:28.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400c3020 con 0x7f8a4c073790 2024-04-26T22:21:28.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.696+0000 7fbf32000640 1 -- 172.21.15.16:0/1824522906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c13efb0 con 0x7fbf2c068c60 2024-04-26T22:21:28.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0b9d50 con 0x7f8a4c073790 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c072160 con 0x7f8a4c073790 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a400bf850 con 0x7f8a4c073790 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400c3020 con 0x7f8a4c073790 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f5086a00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 0x7f506806a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f508001e390 tx=0x7f50800a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf200c2060 con 0x7fbf2c068c60 2024-04-26T22:21:28.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.700+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e240bd020 con 0x7f4e3809bed0 2024-04-26T22:21:28.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e38069450 con 0x7f4e3809bed0 2024-04-26T22:21:28.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf2c0506d0 con 0x7fbf2c068c60 2024-04-26T22:21:28.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7fbf28c00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 0x7fbf0c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f507800e070 con 0x7f5088073bd0 2024-04-26T22:21:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f4e2fe00640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 0x7f4e1806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a280052a0 con 0x7f8a4c073790 2024-04-26T22:21:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a400c6020 con 0x7f8a4c073790 2024-04-26T22:21:28.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbf20123a90 con 0x7fbf2c068c60 2024-04-26T22:21:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4e24120d30 con 0x7f4e3809bed0 2024-04-26T22:21:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7fbf2be00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 0x7fbf0c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f4e37400640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 0x7f4e1806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f8a49600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 0x7f8a2c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:28.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8a40128fa0 con 0x7f8a4c073790 2024-04-26T22:21:28.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7fbf2be00640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 0x7fbf0c06a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c1485e0 tx=0x7fbf18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.704+0000 7f4e37400640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 0x7f4e1806a910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e38135a70 tx=0x7f4e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.708+0000 7f8a51200640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 0x7f8a2c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:28.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.708+0000 7f8a51200640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 0x7f8a2c06aa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c1442e0 tx=0x7f8a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:28.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.708+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbf20018870 con 0x7fbf2c068c60 2024-04-26T22:21:28.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.716+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e24126020 con 0x7f4e3809bed0 2024-04-26T22:21:28.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:28.716+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a400cd030 con 0x7f8a4c073790 2024-04-26T22:21:29.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.028+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4c9003c1a0 con 0x7f4c900d9250 2024-04-26T22:21:29.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.028+0000 7f4c8ea00640 1 -- 172.21.15.16:0/3665202800 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c980927a0 con 0x7f4c900d9250 2024-04-26T22:21:29.031 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 msgr2=0x7f4c7806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 0x7f4c7806a890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c9016f4a0 tx=0x7f4c88009240 comp rx=0 tx=0).stop 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 msgr2=0x7f4c90172170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 0x7f4c90172170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4c98051520 tx=0x7f4c9806c1e0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 shutdown_connections 2024-04-26T22:21:29.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c780683d0 0x7f4c7806a890 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c900d9250 0x7f4c90172170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c90035be0 0x7f4c90171c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 --2- 172.21.15.16:0/3665202800 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c900064b0 0x7f4c900c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 >> 172.21.15.16:0/3665202800 conn(0x7f4c9003b120 msgr2=0x7f4c900071b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 shutdown_connections 2024-04-26T22:21:29.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.032+0000 7f4c9d400640 1 -- 172.21.15.16:0/3665202800 wait complete. 2024-04-26T22:21:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.044+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcbf00b9140 con 0x7fcbf00b66b0 2024-04-26T22:21:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.044+0000 7fcbed600640 1 -- 172.21.15.16:0/1232813859 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcbe4056d40 con 0x7fcbf00b66b0 2024-04-26T22:21:29.046 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-04-26T22:21:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.044+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff92c09bc30 con 0x7ff92c142920 2024-04-26T22:21:29.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.044+0000 7ff928c00640 1 -- 172.21.15.16:0/774875887 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff92c09bc30 con 0x7ff92c142920 2024-04-26T22:21:29.049 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-04-26T22:21:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 msgr2=0x7fcbd006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 0x7fcbd006a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0097c0 tx=0x7fcbdc008040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 msgr2=0x7fcbf00722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf00722b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400b410 tx=0x7fcbe400b8d0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 shutdown_connections 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcbd0068450 0x7fcbd006a910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf013f7e0 0x7fcbf00727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcbf00b66b0 0x7fcbf00722b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 --2- 172.21.15.16:0/1232813859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcbf00b19f0 0x7fcbf00b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 >> 172.21.15.16:0/1232813859 conn(0x7fcbf006c400 msgr2=0x7fcbf00b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.051 INFO:teuthology.orchestra.run.smithi016.stdout:60129542149 2024-04-26T22:21:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 shutdown_connections 2024-04-26T22:21:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4d481424f0 con 0x7f4d480ba0e0 2024-04-26T22:21:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7f4d45600640 1 -- 172.21.15.16:0/3971208281 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d3405a980 con 0x7f4d480ba0e0 2024-04-26T22:21:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7fcbf8000640 1 -- 172.21.15.16:0/1232813859 wait complete. 2024-04-26T22:21:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 msgr2=0x7ff90c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 0x7ff90c06a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff92001af20 tx=0x7ff9200a7070 comp rx=0 tx=0).stop 2024-04-26T22:21:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 msgr2=0x7ff92c0ba550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.048+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0ba550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d560 tx=0x7ff92400da20 comp rx=0 tx=0).stop 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 shutdown_connections 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff90c068380 0x7ff90c06a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92c142920 0x7ff92c0ba550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff92c0bd5a0 0x7ff92c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 --2- 172.21.15.16:0/774875887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff92c09bed0 0x7ff92c0bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 >> 172.21.15.16:0/774875887 conn(0x7ff92c068850 msgr2=0x7ff92c141670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 shutdown_connections 2024-04-26T22:21:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7ff933600640 1 -- 172.21.15.16:0/774875887 wait complete. 2024-04-26T22:21:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 msgr2=0x7f4d2806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 0x7f4d2806a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4d4814aa00 tx=0x7f4d3c009040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 msgr2=0x7f4d48141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 0x7f4d48141ad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c7f0 tx=0x7f4d3400ccb0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 shutdown_connections 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d28068450 0x7f4d2806a910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d480baf50 0x7f4d481e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d480bab70 0x7f4d481e8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 --2- 172.21.15.16:0/3971208281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d480ba0e0 0x7f4d48141ad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 >> 172.21.15.16:0/3971208281 conn(0x7f4d48068540 msgr2=0x7f4d480b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 shutdown_connections 2024-04-26T22:21:29.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.052+0000 7f4d4fe00640 1 -- 172.21.15.16:0/3971208281 wait complete. 2024-04-26T22:21:29.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.060+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f50880506d0 con 0x7f5088073bd0 2024-04-26T22:21:29.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.060+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4e380a3230 con 0x7f4e3809bed0 2024-04-26T22:21:29.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.060+0000 7f507ea00640 1 -- 172.21.15.16:0/2685348922 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50780563a0 con 0x7f5088073bd0 2024-04-26T22:21:29.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.060+0000 7f4e2fe00640 1 -- 172.21.15.16:0/3610905551 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e24016110 con 0x7f4e3809bed0 2024-04-26T22:21:29.062 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:29.063 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-04-26T22:21:29.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8a28005860 con 0x7f8a4c073790 2024-04-26T22:21:29.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbf2c073280 con 0x7fbf2c068c60 2024-04-26T22:21:29.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f8a49600640 1 -- 172.21.15.16:0/1135216487 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a4001a3c0 con 0x7f8a4c073790 2024-04-26T22:21:29.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7fbf28c00640 1 -- 172.21.15.16:0/1824522906 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf200f40c0 con 0x7fbf2c068c60 2024-04-26T22:21:29.065 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2024-04-26T22:21:29.066 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2024-04-26T22:21:29.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 msgr2=0x7f506806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 0x7f506806a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f508001e390 tx=0x7f50800a8070 comp rx=0 tx=0).stop 2024-04-26T22:21:29.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 msgr2=0x7f50881deaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 0x7f50881deaf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f507800b3f0 tx=0x7f507800b8b0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 msgr2=0x7f4e1806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 0x7f4e1806a910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e38135a70 tx=0x7f4e28008040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 msgr2=0x7f4e381e8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ae040 tx=0x7f4e2401ac40 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 shutdown_connections 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4e18068450 0x7f4e1806a910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e38142920 0x7f4e38146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e380bd3d0 0x7f4e3814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 --2- 172.21.15.16:0/3610905551 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4e3809bed0 0x7f4e381e8be0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 >> 172.21.15.16:0/3610905551 conn(0x7f4e38068850 msgr2=0x7f4e380a1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 shutdown_connections 2024-04-26T22:21:29.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f4e3f200640 1 -- 172.21.15.16:0/3610905551 wait complete. 2024-04-26T22:21:29.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 shutdown_connections 2024-04-26T22:21:29.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5068068400 0x7f506806a8c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5088147e50 0x7f50881df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5088073bd0 0x7f50881deaf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 --2- 172.21.15.16:0/2685348922 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50880737f0 0x7f508813a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.064+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 >> 172.21.15.16:0/2685348922 conn(0x7f5088068310 msgr2=0x7f50880b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-04-26T22:21:29.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 shutdown_connections 2024-04-26T22:21:29.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f5087e00640 1 -- 172.21.15.16:0/2685348922 wait complete. 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 msgr2=0x7fbf0c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 0x7fbf0c06a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c1485e0 tx=0x7fbf18008040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 msgr2=0x7fbf2c13fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbf200b3040 tx=0x7fbf2001bab0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 shutdown_connections 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbf0c068480 0x7fbf0c06a940 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c1485e0 tx=0x7fbf18008040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf2c0b25d0 0x7fbf2c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbf2c0736d0 0x7fbf2c140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 --2- 172.21.15.16:0/1824522906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbf2c068c60 0x7fbf2c13fc00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 >> 172.21.15.16:0/1824522906 conn(0x7fbf2c068140 msgr2=0x7fbf2c13dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 msgr2=0x7f8a2c06aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 0x7f8a2c06aa40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c1442e0 tx=0x7f8a38009040 comp rx=0 tx=0).stop 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 msgr2=0x7f8a4c0b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000dbe0 tx=0x7f8a4001d4e0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 shutdown_connections 2024-04-26T22:21:29.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7fbf1e000640 1 -- 172.21.15.16:0/1824522906 wait complete. 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 shutdown_connections 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8a2c068580 0x7f8a2c06aa40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8a4c0b3a70 0x7f8a4c0b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a4c0b1a90 0x7f8a4c0b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 --2- 172.21.15.16:0/1135216487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4c073790 0x7f8a4c0b7840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 >> 172.21.15.16:0/1135216487 conn(0x7f8a4c0b62e0 msgr2=0x7f8a4c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 shutdown_connections 2024-04-26T22:21:29.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:29.068+0000 7f8a54600640 1 -- 172.21.15.16:0/1135216487 wait complete. 2024-04-26T22:21:29.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-04-26T22:21:29.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-04-26T22:21:29.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2024-04-26T22:21:29.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-04-26T22:21:29.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-04-26T22:21:29.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2024-04-26T22:21:29.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-04-26T22:21:30.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T22:21:30.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T22:21:30.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T22:21:30.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T22:21:30.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T22:21:30.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T22:21:30.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T22:21:30.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T22:21:30.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.304+0000 7f4ef7c00640 1 Processor -- start 2024-04-26T22:21:30.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.304+0000 7f4ef7c00640 1 -- start start 2024-04-26T22:21:30.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.304+0000 7f4ef7c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ef013e9f0 0x7f4ef00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4ef7c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef00b4380 con 0x7f4ef01486e0 2024-04-26T22:21:30.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4ef7c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef00b4660 con 0x7f4ef013e610 2024-04-26T22:21:30.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4ef7c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef00b4940 con 0x7f4ef013e9f0 2024-04-26T22:21:30.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4ef5200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4ef013e610 0x7f4ef01479d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47482/0 (socket says 172.21.15.16:47482) 2024-04-26T22:21:30.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4ef5200640 1 -- 172.21.15.16:0/964176091 learned_addr learned my addr 172.21.15.16:0/964176091 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:30.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4eefe00640 1 --2- 172.21.15.16:0/964176091 >> v2:172.21.15.16:3300/0 conn(0x7f4ef013e9f0 0x7f4ef00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4eefe00640 1 -- 172.21.15.16:0/964176091 >> v1:172.21.15.195:6789/0 conn(0x7f4ef013e610 legacy=0x7f4ef01479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4eefe00640 1 -- 172.21.15.16:0/964176091 >> v1:172.21.15.16:6789/0 conn(0x7f4ef01486e0 legacy=0x7f4ef014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.308+0000 7f4eefe00640 1 -- 172.21.15.16:0/964176091 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef00b5c50 con 0x7f4ef013e9f0 2024-04-26T22:21:30.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.316+0000 7f4eefe00640 1 --2- 172.21.15.16:0/964176091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef013e9f0 0x7f4ef00b4e60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097c0 tx=0x7f4edc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bb836ef477da0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.316+0000 7f4eef400640 1 -- 172.21.15.16:0/964176091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0b0070 con 0x7f4ef013e9f0 2024-04-26T22:21:30.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.316+0000 7f4eef400640 1 -- 172.21.15.16:0/964176091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc0ab600 con 0x7f4ef013e9f0 2024-04-26T22:21:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.316+0000 7f4ef7c00640 1 -- 172.21.15.16:0/964176091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef013e9f0 msgr2=0x7f4ef00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.316+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/964176091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef013e9f0 0x7f4ef00b4e60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097c0 tx=0x7f4edc01c4e0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.320+0000 7f4ef7c00640 1 -- 172.21.15.16:0/964176091 shutdown_connections 2024-04-26T22:21:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.320+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/964176091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef013e9f0 0x7f4ef00b4e60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.320+0000 7f4ef7c00640 1 -- 172.21.15.16:0/964176091 >> 172.21.15.16:0/964176091 conn(0x7f4ef00b62e0 msgr2=0x7f4ef00b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.320+0000 7f4ef7c00640 1 -- 172.21.15.16:0/964176091 shutdown_connections 2024-04-26T22:21:30.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.320+0000 7f4ef7c00640 1 -- 172.21.15.16:0/964176091 wait complete. 2024-04-26T22:21:30.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 Processor -- start 2024-04-26T22:21:30.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 -- start start 2024-04-26T22:21:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 0x7f4ef0155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 0x7f4ef0142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 0x7f4ef01432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef5200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 0x7f4ef0155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef5200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 0x7f4ef0155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42046/0 (socket says 172.21.15.16:42046) 2024-04-26T22:21:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4eefe00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 0x7f4ef0142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef5200640 1 -- 172.21.15.16:0/819462663 learned_addr learned my addr 172.21.15.16:0/819462663 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef00b6f50 con 0x7f4ef01486e0 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef00b6dd0 con 0x7f4ef013e9f0 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef01534d0 con 0x7f4ef013e610 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.324+0000 7f4ef5c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 0x7f4ef01432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 -- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 msgr2=0x7f4ef0155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 0x7f4ef0155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 -- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 msgr2=0x7f4ef0142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 0x7f4ef0142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef0144820 con 0x7f4ef01486e0 2024-04-26T22:21:30.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4eefe00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 0x7f4ef0142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:30.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef5c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 0x7f4ef01432e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c700 tx=0x7f4ee800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8003b80 con 0x7f4ef01486e0 2024-04-26T22:21:30.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef00728e0 con 0x7f4ef01486e0 2024-04-26T22:21:30.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef0144540 con 0x7f4ef01486e0 2024-04-26T22:21:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8003d20 con 0x7f4ef01486e0 2024-04-26T22:21:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.328+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8003b80 con 0x7f4ef01486e0 2024-04-26T22:21:30.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.332+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ecc0052a0 con 0x7f4ef01486e0 2024-04-26T22:21:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.340+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ee80050d0 con 0x7f4ef01486e0 2024-04-26T22:21:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.340+0000 7f4eecc00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 0x7f4ed006ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.340+0000 7f4ef5200640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 0x7f4ed006ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.340+0000 7f4ef5200640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 0x7f4ed006ac40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4007fd0 tx=0x7f4ee4007f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.340+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4ee8003980 con 0x7f4ef01486e0 2024-04-26T22:21:30.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.348+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4ee8057170 con 0x7f4ef01486e0 2024-04-26T22:21:30.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 Processor -- start 2024-04-26T22:21:30.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7ff4cea00640 1 Processor -- start 2024-04-26T22:21:30.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 -- start start 2024-04-26T22:21:30.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7ff4cea00640 1 -- start start 2024-04-26T22:21:30.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20300b0600 0x7f20300b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b4a70 0x7f20300b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20300b4ec0 con 0x7f203014bd10 2024-04-26T22:21:30.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f203014c7e0 con 0x7f20300b0600 2024-04-26T22:21:30.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.368+0000 7f202f200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f20300aeac0 con 0x7f20300b4a70 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202de00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f203014bd10 0x7f20300afef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47490/0 (socket says 172.21.15.16:47490) 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202de00640 1 -- 172.21.15.16:0/1332498124 learned_addr learned my addr 172.21.15.16:0/1332498124 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202e800640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b4a70 0x7f20300b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202d400640 1 --2- 172.21.15.16:0/1332498124 >> v2:172.21.15.16:3300/0 conn(0x7f20300b0600 0x7f20300b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202ca00640 1 -- 172.21.15.16:0/1332498124 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015602343 0 0) 0x7f20300b4ec0 con 0x7f203014bd10 2024-04-26T22:21:30.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202ca00640 1 -- 172.21.15.16:0/1332498124 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2014003530 con 0x7f203014bd10 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4cea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4c814bd10 0x7ff4c80afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4cea00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c80b08a0 con 0x7ff4c80b4c40 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4cea00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c814c0f0 con 0x7ff4c80b0430 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4cea00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c814c7e0 con 0x7ff4c814bd10 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4ccc00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7ff4c80b0430 0x7ff4c80b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47494/0 (socket says 172.21.15.16:47494) 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4ce000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff4c80b4c40 0x7ff4c80b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59492/0 (socket says 172.21.15.16:59492) 2024-04-26T22:21:30.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4ccc00640 1 -- 172.21.15.16:0/3561833617 learned_addr learned my addr 172.21.15.16:0/3561833617 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:30.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202d400640 1 -- 172.21.15.16:0/1332498124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b4a70 msgr2=0x7f20300b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202d400640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b4a70 0x7f20300b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202d400640 1 -- 172.21.15.16:0/1332498124 >> v1:172.21.15.195:6789/0 conn(0x7f203014bd10 legacy=0x7f20300afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7f202d400640 1 -- 172.21.15.16:0/1332498124 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203014c0f0 con 0x7f20300b0600 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124823847 0 0) 0x7ff4c814c0f0 con 0x7ff4c80b0430 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b0003530 con 0x7ff4c80b0430 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3561833617 >> v2:172.21.15.16:3300/0 conn(0x7ff4c814bd10 0x7ff4c80afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329216703 0 0) 0x7ff4c80b08a0 con 0x7ff4c80b4c40 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c814c0f0 con 0x7ff4c80b4c40 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2576662490 0 0) 0x7ff4c814c0f0 con 0x7ff4c80b4c40 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 >> v2:172.21.15.16:3300/0 conn(0x7ff4c814bd10 msgr2=0x7ff4c80afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 --2- 172.21.15.16:0/3561833617 >> v2:172.21.15.16:3300/0 conn(0x7ff4c814bd10 0x7ff4c80afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 >> v1:172.21.15.195:6789/0 conn(0x7ff4c80b0430 legacy=0x7ff4c80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c80b3410 con 0x7ff4c80b4c40 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7ff4c0001930 con 0x7ff4c80b4c40 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 >> v1:172.21.15.16:6789/0 conn(0x7ff4c80b4c40 legacy=0x7ff4c80b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4b0003ba0 0x7ff4b0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4b0004810 0x7ff4b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c814c7e0 con 0x7ff4b0004810 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b000c1d0 con 0x7ff4b0003ba0 2024-04-26T22:21:30.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.372+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b000c3d0 con 0x7ff4b0005290 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4b0003ba0 0x7ff4b0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ccc00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4b0004810 0x7ff4b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 Processor -- start 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 -- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4b0003ba0 msgr2=0x7ff4b0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4b0003ba0 0x7ff4b0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 -- 172.21.15.16:0/3561833617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4b0004810 msgr2=0x7ff4b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4b0004810 0x7ff4b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 -- start start 2024-04-26T22:21:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7ff4ce000640 1 -- 172.21.15.16:0/3561833617 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c80b3410 con 0x7ff4b0005290 2024-04-26T22:21:30.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202d400640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b0600 0x7f20300b4530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e2da1d273134be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 Processor -- start 2024-04-26T22:21:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202ca00640 1 -- 172.21.15.16:0/1332498124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b0070 con 0x7f20300b0600 2024-04-26T22:21:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe18c13e610 0x7fe18c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18c0b4380 con 0x7fe18c13e9f0 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18c0b4660 con 0x7fe18c1486e0 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe193e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe18c0b4940 con 0x7fe18c13e610 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe190a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe18c13e9f0 0x7fe18c0b4e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59508/0 (socket says 172.21.15.16:59508) 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe190a00640 1 -- 172.21.15.16:0/178906376 learned_addr learned my addr 172.21.15.16:0/178906376 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe191400640 1 --2- 172.21.15.16:0/178906376 >> v2:172.21.15.195:3300/0 conn(0x7fe18c13e610 0x7fe18c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559294855 0 0) 0x7fe18c0b4380 con 0x7fe18c13e9f0 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe174003530 con 0x7fe18c13e9f0 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7fe191400640 1 -- 172.21.15.16:0/178906376 >> v1:172.21.15.195:6789/0 conn(0x7fe18c1486e0 legacy=0x7fe18c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 -- start start 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd406e950 0x7f8cd4073790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8cd40b3a70 0x7f8cd4144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd40b0940 con 0x7f8cd40b1550 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd4073cd0 con 0x7f8cd40b3a70 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f8cda000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd40b06f0 con 0x7f8cd406e950 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683876302 0 0) 0x7fe18c0b4660 con 0x7fe18c1486e0 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202ca00640 1 -- 172.21.15.16:0/1332498124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c0ab600 con 0x7f20300b0600 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202ca00640 1 -- 172.21.15.16:0/1332498124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c0ab9d0 con 0x7f20300b0600 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 -- 172.21.15.16:0/1332498124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b0600 msgr2=0x7f20300b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b0600 0x7f20300b4530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c380 comp rx=0 tx=0).stop 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 -- 172.21.15.16:0/1332498124 shutdown_connections 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b4a70 0x7f20300b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 --2- 172.21.15.16:0/1332498124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b0600 0x7f20300b4530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.376+0000 7f202f200640 1 -- 172.21.15.16:0/1332498124 >> 172.21.15.16:0/1332498124 conn(0x7f20300b6350 msgr2=0x7f20300b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f202f200640 1 -- 172.21.15.16:0/1332498124 shutdown_connections 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7fe191400640 1 -- 172.21.15.16:0/178906376 >> v1:172.21.15.16:6789/0 conn(0x7fe18c13e9f0 legacy=0x7fe18c0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7fe191400640 1 -- 172.21.15.16:0/178906376 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c0b5c50 con 0x7fe18c13e610 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8cd40b3a70 0x7f8cd4144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8cd40b3a70 0x7f8cd4144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41786/0 (socket says 172.21.15.16:41786) 2024-04-26T22:21:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f202f200640 1 -- 172.21.15.16:0/1332498124 wait complete. 2024-04-26T22:21:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 -- 172.21.15.16:0/1732574793 learned_addr learned my addr 172.21.15.16:0/1732574793 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd3400640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd406e950 0x7f8cd4073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 -- 172.21.15.16:0/1732574793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd406e950 msgr2=0x7f8cd4073790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd406e950 0x7f8cd4073790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 -- 172.21.15.16:0/1732574793 >> v1:172.21.15.195:6789/0 conn(0x7f8cd40b1550 legacy=0x7f8cd41478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f8cd2a00640 1 -- 172.21.15.16:0/1732574793 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd4144c80 con 0x7f8cd40b3a70 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7ff4ce000640 1 -- 172.21.15.16:0/3561833617 reap_dead start 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7ff4ce000640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4b000b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c4e0 tx=0x7ff4c001ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9041266e898206f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000c0e0 con 0x7ff4b0005290 2024-04-26T22:21:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c00a9070 con 0x7ff4b0005290 2024-04-26T22:21:30.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7ff4c7e00640 1 -- 172.21.15.16:0/3561833617 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00a58e0 con 0x7ff4b0005290 2024-04-26T22:21:30.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f9396e00640 1 Processor -- start 2024-04-26T22:21:30.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f9396e00640 1 -- start start 2024-04-26T22:21:30.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f202f200640 1 Processor -- start 2024-04-26T22:21:30.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f202f200640 1 -- start start 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f9396e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f93900b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.380+0000 7f9396e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9390073bd0 0x7f9390147910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 -- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 msgr2=0x7ff4b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4b000b9d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c4e0 tx=0x7ff4c001ce00 comp rx=0 tx=0).stop 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9396e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93900b1c30 con 0x7f9390147e50 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9396e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f93900b2710 con 0x7f9390073bd0 2024-04-26T22:21:30.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9396e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93900b2280 con 0x7f93900737f0 2024-04-26T22:21:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 0x7f20300ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9390073bd0 0x7f9390147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9390073bd0 0x7f9390147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58022/0 (socket says 172.21.15.16:58022) 2024-04-26T22:21:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 -- 172.21.15.16:0/412492863 learned_addr learned my addr 172.21.15.16:0/412492863 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b4a70 0x7f20300adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395a00640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f93900b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 -- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 msgr2=0x7f93900b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2030155990 con 0x7f20300b4a70 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2030155810 con 0x7f203014bd10 2024-04-26T22:21:30.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202f200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2030155b10 con 0x7f20300b0600 2024-04-26T22:21:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 -- 172.21.15.16:0/3561833617 shutdown_connections 2024-04-26T22:21:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3561833617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4b000b9d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 -- 172.21.15.16:0/3561833617 >> 172.21.15.16:0/3561833617 conn(0x7ff4c80b6350 msgr2=0x7ff4c80b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 0x7f20300ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe191400640 1 --2- 172.21.15.16:0/178906376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c13e610 0x7fe18c1479d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe18001d510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48c15b5ff9dc2b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f93900b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 -- 172.21.15.16:0/412492863 >> v1:172.21.15.195:6789/0 conn(0x7f9390147e50 legacy=0x7f93900b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58026/0 (socket says 172.21.15.16:58026) 2024-04-26T22:21:30.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 -- 172.21.15.16:0/1665728781 learned_addr learned my addr 172.21.15.16:0/1665728781 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202d400640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b4a70 0x7f20300adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 -- 172.21.15.16:0/3561833617 shutdown_connections 2024-04-26T22:21:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7ff4cea00640 1 -- 172.21.15.16:0/3561833617 wait complete. 2024-04-26T22:21:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178004e70 con 0x7fe18c13e610 2024-04-26T22:21:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1800b0070 con 0x7fe18c13e610 2024-04-26T22:21:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe18be00640 1 -- 172.21.15.16:0/178906376 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178004e70 con 0x7fe18c13e610 2024-04-26T22:21:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395000640 1 -- 172.21.15.16:0/412492863 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93900b1f10 con 0x7f9390073bd0 2024-04-26T22:21:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9395a00640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f93900b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f8cd2a00640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd40b3a70 0x7f8cd4144310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009870 tx=0x7f8cc001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7d6c213498d346 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 -- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 msgr2=0x7f20300ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 0x7f20300ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 -- 172.21.15.16:0/1665728781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b4a70 msgr2=0x7f20300adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b4a70 0x7f20300adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 -- 172.21.15.16:0/1665728781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20300abfa0 con 0x7f203014bd10 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202de00640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 0x7f20300ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe193e00640 1 -- 172.21.15.16:0/178906376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c13e610 msgr2=0x7fe18c1479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe193e00640 1 --2- 172.21.15.16:0/178906376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c13e610 0x7fe18c1479d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe18001d510 comp rx=0 tx=0).stop 2024-04-26T22:21:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f8cd2000640 1 -- 172.21.15.16:0/1732574793 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00b0070 con 0x7f8cd40b3a70 2024-04-26T22:21:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f202e800640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2028009dd0 tx=0x7f202800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f9bfe800640 1 Processor -- start 2024-04-26T22:21:30.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe193e00640 1 -- 172.21.15.16:0/178906376 shutdown_connections 2024-04-26T22:21:30.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe193e00640 1 --2- 172.21.15.16:0/178906376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c13e610 0x7fe18c1479d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7fe193e00640 1 -- 172.21.15.16:0/178906376 >> 172.21.15.16:0/178906376 conn(0x7fe18c0b62e0 msgr2=0x7fe18c0b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f8cd2000640 1 -- 172.21.15.16:0/1732574793 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00ab600 con 0x7f8cd40b3a70 2024-04-26T22:21:30.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.384+0000 7f8cd2000640 1 -- 172.21.15.16:0/1732574793 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00ab9d0 con 0x7f8cd40b3a70 2024-04-26T22:21:30.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 -- start start 2024-04-26T22:21:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fe193e00640 1 -- 172.21.15.16:0/178906376 shutdown_connections 2024-04-26T22:21:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028018020 con 0x7f203014bd10 2024-04-26T22:21:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2028014480 con 0x7f203014bd10 2024-04-26T22:21:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028014850 con 0x7f203014bd10 2024-04-26T22:21:30.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20300ad4f0 con 0x7f203014bd10 2024-04-26T22:21:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fe193e00640 1 -- 172.21.15.16:0/178906376 wait complete. 2024-04-26T22:21:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20300aa9e0 con 0x7f203014bd10 2024-04-26T22:21:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 -- 172.21.15.16:0/1732574793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd40b3a70 msgr2=0x7f8cd4144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd40b3a70 0x7f8cd4144310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009870 tx=0x7f8cc001c4f0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 -- 172.21.15.16:0/1732574793 shutdown_connections 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd40b3a70 0x7f8cd4144310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 --2- 172.21.15.16:0/1732574793 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd406e950 0x7f8cd4073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 -- 172.21.15.16:0/1732574793 >> 172.21.15.16:0/1732574793 conn(0x7f8cd40b62e0 msgr2=0x7f8cd40b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20300506d0 con 0x7f203014bd10 2024-04-26T22:21:30.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 -- 172.21.15.16:0/1732574793 shutdown_connections 2024-04-26T22:21:30.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fe193e00640 1 Processor -- start 2024-04-26T22:21:30.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fe193e00640 1 -- start start 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9bf8073960 0x7f9bf81465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80b8380 con 0x7f9bf8071910 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf80b69c0 con 0x7f9bf8073960 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bfe800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf80728a0 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bf7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bf7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42094/0 (socket says 172.21.15.16:42094) 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f9bf7400640 1 -- 172.21.15.16:0/4232652289 learned_addr learned my addr 172.21.15.16:0/4232652289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7ff4cea00640 1 Processor -- start 2024-04-26T22:21:30.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7ff4cea00640 1 -- start start 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7f8cda000640 1 -- 172.21.15.16:0/1732574793 wait complete. 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fdd93e00640 1 Processor -- start 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fdd93e00640 1 -- start start 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.388+0000 7fe193e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 0x7fe18c137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe193e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe193e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe193e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c152dc0 con 0x7fe18c13e610 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe193e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c152c40 con 0x7fe18c1486e0 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe193e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c152f40 con 0x7fe18c13e9f0 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9bf7e00640 1 --2- 172.21.15.16:0/4232652289 >> v2:172.21.15.16:3300/0 conn(0x7f9bf8073960 0x7f9bf81465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd93e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd940737f0 0x7fdd940b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd93e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd94073bd0 0x7fdd94147910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f202801b020 con 0x7f203014bd10 2024-04-26T22:21:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd93e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd940b1c30 con 0x7fdd94147e50 2024-04-26T22:21:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd93e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdd940b2710 con 0x7fdd94073bd0 2024-04-26T22:21:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd93e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd940b2280 con 0x7fdd940737f0 2024-04-26T22:21:30.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9395000640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390073bd0 0x7f9390147910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f937c008870 tx=0x7f937c01e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0779d551818ab5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe191e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd94073bd0 0x7fdd94147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd94073bd0 0x7fdd94147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58032/0 (socket says 172.21.15.16:58032) 2024-04-26T22:21:30.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 -- 172.21.15.16:0/3726613671 learned_addr learned my addr 172.21.15.16:0/3726613671 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 Processor -- start 2024-04-26T22:21:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4c8070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 0x7ff4c81425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4c8142ae0 0x7ff4c81e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42102/0 (socket says 172.21.15.16:42102) 2024-04-26T22:21:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 -- start start 2024-04-26T22:21:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80b0280 con 0x7ff4c8142ae0 2024-04-26T22:21:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 -- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd940737f0 msgr2=0x7fdd940b6800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T22:21:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 --2- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd940737f0 0x7fdd940b6800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 -- 172.21.15.16:0/3726613671 >> v1:172.21.15.16:6789/0 conn(0x7fdd94147e50 legacy=0x7fdd940b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80b0100 con 0x7ff4c8071be0 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe191400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 0x7fe18c137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe191400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 0x7fe18c137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41818/0 (socket says 172.21.15.16:41818) 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe191400640 1 -- 172.21.15.16:0/2318805308 learned_addr learned my addr 172.21.15.16:0/2318805308 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fdd92000640 1 -- 172.21.15.16:0/3726613671 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd940b1f10 con 0x7fdd94073bd0 2024-04-26T22:21:30.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c80b2650 con 0x7ff4b0005290 2024-04-26T22:21:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe191e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58042/0 (socket says 172.21.15.16:58042) 2024-04-26T22:21:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4ccc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 0x7ff4c81425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4ccc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 0x7ff4c81425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58056/0 (socket says 172.21.15.16:58056) 2024-04-26T22:21:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4ccc00640 1 -- 172.21.15.16:0/3246071030 learned_addr learned my addr 172.21.15.16:0/3246071030 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4c8070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f2026000640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 0x7f201006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd406e950 0x7f8cd4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 -- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 msgr2=0x7ff4c81425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 0x7ff4c81425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 -- 172.21.15.16:0/3246071030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4c8142ae0 msgr2=0x7ff4c81e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b1550 0x7f8cd414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2028087350 con 0x7f203014bd10 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f202de00640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 0x7f201006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4c8142ae0 0x7ff4c81e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7ff4cd600640 1 -- 172.21.15.16:0/3246071030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c8142f70 con 0x7ff4b0005290 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 -- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 msgr2=0x7fe18c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 -- 172.21.15.16:0/2318805308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 msgr2=0x7fe18c137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 0x7fe18c137950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7fe190a00640 1 -- 172.21.15.16:0/2318805308 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c143120 con 0x7fe18c13e9f0 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe191e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4144850 con 0x7f8cd406e950 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd414dd30 con 0x7f8cd40b1550 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f8cda000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd41449d0 con 0x7f8cd40b3a70 2024-04-26T22:21:30.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42128/0 (socket says 172.21.15.16:42128) 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 -- 172.21.15.16:0/2963741015 learned_addr learned my addr 172.21.15.16:0/2963741015 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9bf7400640 1 -- 172.21.15.16:0/4232652289 >> v2:172.21.15.16:3300/0 conn(0x7f9bf8073960 msgr2=0x7f9bf81465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9bf7400640 1 --2- 172.21.15.16:0/4232652289 >> v2:172.21.15.16:3300/0 conn(0x7f9bf8073960 0x7f9bf81465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9bf7400640 1 -- 172.21.15.16:0/4232652289 >> v1:172.21.15.195:6789/0 conn(0x7f9bf8071910 legacy=0x7f9bf8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.392+0000 7f9bf7400640 1 -- 172.21.15.16:0/4232652289 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80b6370 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f202de00640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 0x7f201006a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2020007fd0 tx=0x7f2020007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4cd600640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4c8070fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc011990 tx=0x7ff4bc011e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd2a00640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b1550 0x7f8cd414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 -- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b1550 msgr2=0x7f8cd414b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b1550 0x7f8cd414b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 -- 172.21.15.16:0/2963741015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd406e950 msgr2=0x7f8cd4148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd406e950 0x7f8cd4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe190a00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d800 tx=0x7fe17800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00f9b0 con 0x7ff4b0005290 2024-04-26T22:21:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 -- 172.21.15.16:0/2963741015 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd414ac80 con 0x7f8cd40b3a70 2024-04-26T22:21:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00fb50 con 0x7ff4b0005290 2024-04-26T22:21:30.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c81459b0 con 0x7ff4b0005290 2024-04-26T22:21:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17800a070 con 0x7fe18c13e9f0 2024-04-26T22:21:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cd3e00640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c740 tx=0x7f8ccc00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17800bba0 con 0x7fe18c13e9f0 2024-04-26T22:21:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178011430 con 0x7fe18c13e9f0 2024-04-26T22:21:30.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c143670 con 0x7fe18c13e9f0 2024-04-26T22:21:30.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81456d0 con 0x7ff4b0005290 2024-04-26T22:21:30.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c072f60 con 0x7fe18c13e9f0 2024-04-26T22:21:30.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc014440 con 0x7ff4b0005290 2024-04-26T22:21:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f938fe00640 1 -- 172.21.15.16:0/412492863 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c0ad070 con 0x7f9390073bd0 2024-04-26T22:21:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f938fe00640 1 -- 172.21.15.16:0/412492863 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c0a7850 con 0x7f9390073bd0 2024-04-26T22:21:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f938fe00640 1 -- 172.21.15.16:0/412492863 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c0a7c20 con 0x7f9390073bd0 2024-04-26T22:21:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc016020 con 0x7f8cd40b3a70 2024-04-26T22:21:30.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c0506d0 con 0x7fe18c13e9f0 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00ce50 con 0x7f8cd40b3a70 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc003980 con 0x7f8cd40b3a70 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd414af60 con 0x7f8cd40b3a70 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41386f0 con 0x7f8cd40b3a70 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f9bf7400640 1 --2- 172.21.15.16:0/4232652289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009870 tx=0x7f9be801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7ea7c15a74af0cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f9bf6000640 1 -- 172.21.15.16:0/4232652289 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be80b0070 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f9bf6000640 1 -- 172.21.15.16:0/4232652289 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be8004230 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.396+0000 7f9bf6000640 1 -- 172.21.15.16:0/4232652289 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8003620 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 -- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390073bd0 msgr2=0x7f9390147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390073bd0 0x7f9390147910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f937c008870 tx=0x7f937c01e9c0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cac0052a0 con 0x7f8cd40b3a70 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 -- 172.21.15.16:0/412492863 shutdown_connections 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390073bd0 0x7f9390147910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 --2- 172.21.15.16:0/412492863 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f93900b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 -- 172.21.15.16:0/412492863 >> 172.21.15.16:0/412492863 conn(0x7f9390068310 msgr2=0x7f9390068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 -- 172.21.15.16:0/4232652289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 msgr2=0x7f9bf80b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 --2- 172.21.15.16:0/4232652289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009870 tx=0x7f9be801c460 comp rx=0 tx=0).stop 2024-04-26T22:21:30.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2028022070 con 0x7f203014bd10 2024-04-26T22:21:30.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1780115d0 con 0x7fe18c13e9f0 2024-04-26T22:21:30.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 -- 172.21.15.16:0/412492863 shutdown_connections 2024-04-26T22:21:30.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9396e00640 1 -- 172.21.15.16:0/412492863 wait complete. 2024-04-26T22:21:30.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ccc003b20 con 0x7f8cd40b3a70 2024-04-26T22:21:30.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fdd92000640 1 --2- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd94073bd0 0x7fdd94147910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009870 tx=0x7fdd8001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da9659141f0eae22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fdd91600640 1 -- 172.21.15.16:0/3726613671 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800b0070 con 0x7fdd94073bd0 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 -- 172.21.15.16:0/4232652289 shutdown_connections 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 --2- 172.21.15.16:0/4232652289 >> v2:172.21.15.16:3300/0 conn(0x7f9bf8073960 0x7f9bf81465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 --2- 172.21.15.16:0/4232652289 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf80b7fa0 0x7f9bf80b5c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 -- 172.21.15.16:0/4232652289 >> 172.21.15.16:0/4232652289 conn(0x7f9bf806cb40 msgr2=0x7f9bf80b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4bc012040 con 0x7ff4b0005290 2024-04-26T22:21:30.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c80506d0 con 0x7ff4b0005290 2024-04-26T22:21:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7ff4c5600640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 0x7ff4a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4bc086f90 con 0x7ff4b0005290 2024-04-26T22:21:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 -- 172.21.15.16:0/4232652289 shutdown_connections 2024-04-26T22:21:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f8ccb400640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 0x7f8cb406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8ccc086910 con 0x7f8cd40b3a70 2024-04-26T22:21:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fe189600640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 0x7fe16c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe1780871e0 con 0x7fe18c13e9f0 2024-04-26T22:21:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f8cd3400640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 0x7f8cb406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7f9bfe800640 1 -- 172.21.15.16:0/4232652289 wait complete. 2024-04-26T22:21:30.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7ff4ccc00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 0x7ff4a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fe191400640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 0x7fe16c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f8cd3400640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 0x7f8cb406a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006aa0 tx=0x7f8cc4006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7ff4ccc00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 0x7ff4a806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8070cf0 tx=0x7ff4b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fe191400640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 0x7fe16c06a910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe1800a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 Processor -- start 2024-04-26T22:21:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fdd91600640 1 -- 172.21.15.16:0/3726613671 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd800ab600 con 0x7fdd94073bd0 2024-04-26T22:21:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.400+0000 7fdd91600640 1 -- 172.21.15.16:0/3726613671 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800ab9d0 con 0x7fdd94073bd0 2024-04-26T22:21:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 -- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd94073bd0 msgr2=0x7fdd94147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 --2- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd94073bd0 0x7fdd94147910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009870 tx=0x7fdd8001c4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 -- 172.21.15.16:0/3726613671 shutdown_connections 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 --2- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd94073bd0 0x7fdd94147910 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009870 tx=0x7fdd8001c4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 --2- 172.21.15.16:0/3726613671 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd940737f0 0x7fdd940b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 -- 172.21.15.16:0/3726613671 >> 172.21.15.16:0/3726613671 conn(0x7fdd94068310 msgr2=0x7fdd94068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 -- 172.21.15.16:0/3726613671 shutdown_connections 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 -- start start 2024-04-26T22:21:30.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9396e00640 1 Processor -- start 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7fdd93e00640 1 -- 172.21.15.16:0/3726613671 wait complete. 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf8071910 0x7f9bf8144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 0x7f9bf813b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf8159da0 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf8159c20 con 0x7f9bf8073960 2024-04-26T22:21:30.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bfe800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf8159f20 con 0x7f9bf8071910 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9396e00640 1 -- start start 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bf6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bf7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf8071910 0x7f9bf8144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bf6a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58066/0 (socket says 172.21.15.16:58066) 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bf7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 0x7f9bf813b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.404+0000 7f9bf6a00640 1 -- 172.21.15.16:0/164035283 learned_addr learned my addr 172.21.15.16:0/164035283 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f9390142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 Processor -- start 2024-04-26T22:21:30.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8ccc020020 con 0x7f8cd40b3a70 2024-04-26T22:21:30.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 -- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf8071910 msgr2=0x7f9bf8144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf8071910 0x7f9bf8144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 -- start start 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 -- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 msgr2=0x7f9bf81e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 -- 172.21.15.16:0/164035283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf813d680 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf6a00640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:30.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 0x7f9390142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390147e50 0x7f93901dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f93900b5ed0 con 0x7f9390073bd0 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f93900b5d50 con 0x7f9390147e50 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f93900b3c70 con 0x7f93900737f0 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 0x7f9390142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 0x7f9390142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41844/0 (socket says 172.21.15.16:41844) 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395000640 1 -- 172.21.15.16:0/4068754330 learned_addr learned my addr 172.21.15.16:0/4068754330 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f9390142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bf7e00640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 0x7f9bf813b370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000efc0 tx=0x7f9bf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0018020 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0014480 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0014870 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9396400640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390147e50 0x7f93901dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 -- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390147e50 msgr2=0x7f93901dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390147e50 0x7f93901dcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 -- 172.21.15.16:0/4068754330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 msgr2=0x7f9390142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 0x7f9390142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 -- 172.21.15.16:0/4068754330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93901464e0 con 0x7f93900737f0 2024-04-26T22:21:30.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd94147e50 0x7fdd94140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 0x7fdd941e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940b5ed0 con 0x7fdd941e9000 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdd940b5d50 con 0x7fdd940737f0 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd93e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd940b3c70 con 0x7fdd94147e50 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf813de20 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf813d900 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9395a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f9390142360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f938400cdb0 tx=0x7f938400a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58084/0 (socket says 172.21.15.16:58084) 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 -- 172.21.15.16:0/2727354773 learned_addr learned my addr 172.21.15.16:0/2727354773 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 -- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd94147e50 msgr2=0x7fdd94140820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd94147e50 0x7fdd94140820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7fdd92a00640 1 -- 172.21.15.16:0/2727354773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 msgr2=0x7fdd941e94b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd93400640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 0x7fdd941e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd92a00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 0x7fdd941e94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd92a00640 1 -- 172.21.15.16:0/2727354773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd941462c0 con 0x7fdd940737f0 2024-04-26T22:21:30.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.408+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf813db00 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd93400640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 0x7fdd941e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd92a00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00bab0 tx=0x7fdd8c00bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c019070 con 0x7fdd940737f0 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00cc80 con 0x7fdd940737f0 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c014680 con 0x7fdd940737f0 2024-04-26T22:21:30.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe178057780 con 0x7fe18c13e9f0 2024-04-26T22:21:30.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd940aae30 con 0x7fdd940737f0 2024-04-26T22:21:30.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.412+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd94141cf0 con 0x7fdd940737f0 2024-04-26T22:21:30.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd940506d0 con 0x7fdd940737f0 2024-04-26T22:21:30.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938400f680 con 0x7f93900737f0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9bf001b020 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9bef400640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 0x7f9bd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf00876f0 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938400f820 con 0x7f93900737f0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9396e00640 1 -- 172.21.15.16:0/4068754330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93901454c0 con 0x7f93900737f0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938400fbf0 con 0x7f93900737f0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9396e00640 1 -- 172.21.15.16:0/4068754330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901435a0 con 0x7f93900737f0 2024-04-26T22:21:30.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9bf7400640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 0x7f9bd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff4bc019030 con 0x7ff4b0005290 2024-04-26T22:21:30.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.420+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd8c01c070 con 0x7fdd940737f0 2024-04-26T22:21:30.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.416+0000 7f9bf7400640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 0x7f9bd806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9be80ad000 tx=0x7f9be80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.420+0000 7fdd8b400640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 0x7fdd7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.420+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c086620 con 0x7fdd940737f0 2024-04-26T22:21:30.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.424+0000 7fdd92000640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 0x7fdd7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.424+0000 7fdd92000640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 0x7fdd7406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd800ad000 tx=0x7fdd800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.424+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93900506d0 con 0x7f93900737f0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.424+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9384018400 con 0x7f93900737f0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7f938d600640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 0x7f937006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9384087590 con 0x7f93900737f0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7f9395000640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 0x7f937006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9bf813db00 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd8c056580 con 0x7fdd940737f0 2024-04-26T22:21:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.428+0000 7f9395000640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 0x7f937006a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c10 tx=0x7f937c00a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.432+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9384014030 con 0x7f93900737f0 2024-04-26T22:21:30.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.724+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4ecc005860 con 0x7f4ef01486e0 2024-04-26T22:21:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.724+0000 7f4eecc00640 1 -- 172.21.15.16:0/819462663 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ee8056a70 con 0x7f4ef01486e0 2024-04-26T22:21:30.726 INFO:teuthology.orchestra.run.smithi016.stdout:64424509449 2024-04-26T22:21:30.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 msgr2=0x7f4ed006ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 0x7f4ed006ac40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4007fd0 tx=0x7f4ee4007f20 comp rx=0 tx=0).stop 2024-04-26T22:21:30.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 msgr2=0x7f4ef01432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 0x7f4ef01432e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c700 tx=0x7f4ee800cbc0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 shutdown_connections 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4ed0068780 0x7f4ed006ac40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ef01486e0 0x7f4ef01432e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ef013e9f0 0x7f4ef0142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 --2- 172.21.15.16:0/819462663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ef013e610 0x7f4ef0155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 >> 172.21.15.16:0/819462663 conn(0x7f4ef00b62e0 msgr2=0x7f4ef0153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 shutdown_connections 2024-04-26T22:21:30.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.728+0000 7f4ef7c00640 1 -- 172.21.15.16:0/819462663 wait complete. 2024-04-26T22:21:30.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.752+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8cac005860 con 0x7f8cd40b3a70 2024-04-26T22:21:30.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.752+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f20300b7cd0 con 0x7f203014bd10 2024-04-26T22:21:30.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.752+0000 7f2026000640 1 -- 172.21.15.16:0/1665728781 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2028010040 con 0x7f203014bd10 2024-04-26T22:21:30.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.752+0000 7f8ccb400640 1 -- 172.21.15.16:0/2963741015 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ccc056f40 con 0x7f8cd40b3a70 2024-04-26T22:21:30.758 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:30.758 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 msgr2=0x7f8cb406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 0x7f8cb406a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006aa0 tx=0x7f8cc4006a30 comp rx=0 tx=0).stop 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 msgr2=0x7f8cd41e47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c740 tx=0x7f8ccc00cc00 comp rx=0 tx=0).stop 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 msgr2=0x7f201006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 shutdown_connections 2024-04-26T22:21:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8cb40683d0 0x7f8cb406a890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8cd40b3a70 0x7f8cd41e47b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd40b1550 0x7f8cd414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 --2- 172.21.15.16:0/2963741015 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cd406e950 0x7f8cd4148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.756+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 >> 172.21.15.16:0/2963741015 conn(0x7f8cd40b62e0 msgr2=0x7f8cd4142f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe18c0b8d70 con 0x7fe18c13e9f0 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 0x7f201006a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2020007fd0 tx=0x7f2020007d60 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 msgr2=0x7f20300acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2028009dd0 tx=0x7f202800c490 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 shutdown_connections 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2010068450 0x7f201006a910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f203014bd10 0x7f20300acde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20300b4a70 0x7f20300adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 --2- 172.21.15.16:0/1665728781 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20300b0600 0x7f20300ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 >> 172.21.15.16:0/1665728781 conn(0x7f20300b6350 msgr2=0x7f20300b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 shutdown_connections 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f202f200640 1 -- 172.21.15.16:0/1665728781 wait complete. 2024-04-26T22:21:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7fe189600640 1 -- 172.21.15.16:0/2318805308 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe178057080 con 0x7fe18c13e9f0 2024-04-26T22:21:30.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2024-04-26T22:21:30.762 INFO:teuthology.orchestra.run.smithi016.stdout:60129542151 2024-04-26T22:21:30.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 shutdown_connections 2024-04-26T22:21:30.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.760+0000 7f8cda000640 1 -- 172.21.15.16:0/2963741015 wait complete. 2024-04-26T22:21:30.763 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 msgr2=0x7fe16c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 0x7fe16c06a910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe1800a8000 comp rx=0 tx=0).stop 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 msgr2=0x7fe18c0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d800 tx=0x7fe17800dcc0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 shutdown_connections 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe16c068450 0x7fe16c06a910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe18c1486e0 0x7fe18c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe18c13e9f0 0x7fe18c0707a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 --2- 172.21.15.16:0/2318805308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe18c13e610 0x7fe18c137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 >> 172.21.15.16:0/2318805308 conn(0x7fe18c0b62e0 msgr2=0x7fe18c0b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 shutdown_connections 2024-04-26T22:21:30.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7fe193e00640 1 -- 172.21.15.16:0/2318805308 wait complete. 2024-04-26T22:21:30.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff4c81451d0 con 0x7ff4b0005290 2024-04-26T22:21:30.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.764+0000 7ff4c5600640 1 -- 172.21.15.16:0/3246071030 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4bc057540 con 0x7ff4b0005290 2024-04-26T22:21:30.767 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:30.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 msgr2=0x7ff4a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 0x7ff4a806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8070cf0 tx=0x7ff4b4009040 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 msgr2=0x7ff4c8070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4c8070fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc011990 tx=0x7ff4bc011e50 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 shutdown_connections 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff4a8068380 0x7ff4a806a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4c8142ae0 0x7ff4c81e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4c8071be0 0x7ff4c81425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 --2- 172.21.15.16:0/3246071030 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff4b0005290 0x7ff4c8070fc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 >> 172.21.15.16:0/3246071030 conn(0x7ff4c80b6350 msgr2=0x7ff4c80b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 shutdown_connections 2024-04-26T22:21:30.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.768+0000 7ff4cea00640 1 -- 172.21.15.16:0/3246071030 wait complete. 2024-04-26T22:21:30.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.776+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9bf8069450 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.776+0000 7f9bef400640 1 -- 172.21.15.16:0/164035283 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bf0022030 con 0x7f9bf80b7fa0 2024-04-26T22:21:30.779 INFO:teuthology.orchestra.run.smithi016.stdout:64424509448 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 msgr2=0x7f9bd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 0x7f9bd806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9be80ad000 tx=0x7f9be80a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 msgr2=0x7f9bf813b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 0x7f9bf813b370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000efc0 tx=0x7f9bf000c490 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 shutdown_connections 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9bd8068380 0x7f9bd806a840 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9be80ad000 tx=0x7f9be80a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bf80b7fa0 0x7f9bf813b370 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bf8073960 0x7f9bf81e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 --2- 172.21.15.16:0/164035283 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9bf8071910 0x7f9bf8144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 >> 172.21.15.16:0/164035283 conn(0x7f9bf806cb40 msgr2=0x7f9bf806e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 shutdown_connections 2024-04-26T22:21:30.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.780+0000 7f9bfe800640 1 -- 172.21.15.16:0/164035283 wait complete. 2024-04-26T22:21:30.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.788+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdd940b1430 con 0x7fdd940737f0 2024-04-26T22:21:30.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.788+0000 7fdd8b400640 1 -- 172.21.15.16:0/2727354773 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd8c05a880 con 0x7fdd940737f0 2024-04-26T22:21:30.789 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2024-04-26T22:21:30.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.788+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9390144830 con 0x7f93900737f0 2024-04-26T22:21:30.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f938d600640 1 -- 172.21.15.16:0/4068754330 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9384057bc0 con 0x7f93900737f0 2024-04-26T22:21:30.792 INFO:teuthology.orchestra.run.smithi016.stdout:64424509448 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 msgr2=0x7fdd7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 0x7fdd7406a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd800ad000 tx=0x7fdd800a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 msgr2=0x7fdd94072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00bab0 tx=0x7fdd8c00bf70 comp rx=0 tx=0).stop 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 shutdown_connections 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd74068380 0x7fdd7406a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd941e9000 0x7fdd941e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd94147e50 0x7fdd94140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 --2- 172.21.15.16:0/2727354773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd940737f0 0x7fdd94072040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 >> 172.21.15.16:0/2727354773 conn(0x7fdd94068310 msgr2=0x7fdd94146770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 shutdown_connections 2024-04-26T22:21:30.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7fdd93e00640 1 -- 172.21.15.16:0/2727354773 wait complete. 2024-04-26T22:21:30.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 msgr2=0x7f937006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 0x7f937006a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c10 tx=0x7f937c00a040 comp rx=0 tx=0).stop 2024-04-26T22:21:30.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 msgr2=0x7f9390142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f9390142360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f938400cdb0 tx=0x7f938400a650 comp rx=0 tx=0).stop 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 shutdown_connections 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93700683d0 0x7f937006a890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9390147e50 0x7f93901dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9390073bd0 0x7f9390142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 --2- 172.21.15.16:0/4068754330 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f93900737f0 0x7f9390142360 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f938400cdb0 tx=0x7f938400a650 comp rx=0 tx=0).stop 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.792+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 >> 172.21.15.16:0/4068754330 conn(0x7f9390068310 msgr2=0x7f9390146c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.796+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 shutdown_connections 2024-04-26T22:21:30.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:30.796+0000 7f9382a00640 1 -- 172.21.15.16:0/4068754330 wait complete. 2024-04-26T22:21:30.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2024-04-26T22:21:30.797 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-04-26T22:21:30.801 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-04-26T22:21:30.804 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2024-04-26T22:21:30.809 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2024-04-26T22:21:30.815 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.5 2024-04-26T22:21:30.822 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2024-04-26T22:21:30.825 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:30.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T22:21:30.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:21:31.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.008+0000 7fdd6ea00640 1 Processor -- start 2024-04-26T22:21:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 -- start start 2024-04-26T22:21:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd680683a0 0x7fdd680b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd68148d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd68068780 con 0x7fdd680b6890 2024-04-26T22:21:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdd680b6210 con 0x7fdd680683a0 2024-04-26T22:21:31.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd680b64f0 con 0x7fdd680b5d30 2024-04-26T22:21:31.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd5f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdd680b6890 0x7fdd68073820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59520/0 (socket says 172.21.15.16:59520) 2024-04-26T22:21:31.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd5f400640 1 -- 172.21.15.16:0/1824328906 learned_addr learned my addr 172.21.15.16:0/1824328906 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:31.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67e00640 1 --2- 172.21.15.16:0/1824328906 >> v2:172.21.15.195:3300/0 conn(0x7fdd680683a0 0x7fdd680b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd68148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698546395 0 0) 0x7fdd68068780 con 0x7fdd680b6890 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd4c003530 con 0x7fdd680b6890 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157853574 0 0) 0x7fdd4c003530 con 0x7fdd680b6890 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 msgr2=0x7fdd68148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd68148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 >> v2:172.21.15.195:3300/0 conn(0x7fdd680683a0 msgr2=0x7fdd680b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 --2- 172.21.15.16:0/1824328906 >> v2:172.21.15.195:3300/0 conn(0x7fdd680683a0 0x7fdd680b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd680a0380 con 0x7fdd680b6890 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fdd500016a0 con 0x7fdd680b6890 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 >> v1:172.21.15.16:6789/0 conn(0x7fdd680b6890 legacy=0x7fdd68073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c0039c0 0x7fdd4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd4c004d50 0x7fdd4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680b6210 con 0x7fdd4c004d50 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680b64f0 con 0x7fdd4c0039c0 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c00b9d0 con 0x7fdd680b5d30 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67e00640 1 --2- 172.21.15.16:0/1824328906 >> v2:172.21.15.195:3300/0 conn(0x7fdd680683a0 0x7fdd680b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd4c004d50 0x7fdd4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd5f400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd67e00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c0039c0 0x7fdd4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 -- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 msgr2=0x7fdd4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 -- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c0039c0 msgr2=0x7fdd4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c0039c0 0x7fdd4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd6ca00640 1 -- 172.21.15.16:0/1824328906 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c003530 con 0x7fdd4c004d50 2024-04-26T22:21:31.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.012+0000 7fdd5f400640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd680b5d30 0x7fdd4c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:31.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd4c004d50 0x7fdd4c0051d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd680b6140 tx=0x7fdd6001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a289eac78f04a815 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd600b2070 con 0x7fdd4c004d50 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd600a5c30 con 0x7fdd4c004d50 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd67400640 1 -- 172.21.15.16:0/1824328906 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60009c10 con 0x7fdd4c004d50 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 -- 172.21.15.16:0/1824328906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd4c004d50 msgr2=0x7fdd4c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/1824328906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd4c004d50 0x7fdd4c0051d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd680b6140 tx=0x7fdd6001cc20 comp rx=0 tx=0).stop 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ca00640 1 -- 172.21.15.16:0/1824328906 reap_dead start 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 -- 172.21.15.16:0/1824328906 shutdown_connections 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 -- 172.21.15.16:0/1824328906 >> 172.21.15.16:0/1824328906 conn(0x7fdd680bab10 msgr2=0x7fdd680baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 -- 172.21.15.16:0/1824328906 shutdown_connections 2024-04-26T22:21:31.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.016+0000 7fdd6ea00640 1 -- 172.21.15.16:0/1824328906 wait complete. 2024-04-26T22:21:31.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 Processor -- start 2024-04-26T22:21:31.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- start start 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c004d50 0x7fdd68143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd6814c6a0 0x7fdd681e1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68148d70 con 0x7fdd6814b150 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680a0b30 con 0x7fdd4c004d50 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd68148ef0 con 0x7fdd6814c6a0 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41872/0 (socket says 172.21.15.16:41872) 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 -- 172.21.15.16:0/2640047626 learned_addr learned my addr 172.21.15.16:0/2640047626 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd67e00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c004d50 0x7fdd68143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ca00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd6814c6a0 0x7fdd681e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 -- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd6814c6a0 msgr2=0x7fdd681e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd6814c6a0 0x7fdd681e1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 -- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c004d50 msgr2=0x7fdd68143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c004d50 0x7fdd68143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 -- 172.21.15.16:0/2640047626 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6814bbd0 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd5f400640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd50011840 tx=0x7fdd50011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50010040 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5001a070 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000fd60 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6814b8f0 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd681499c0 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.020+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6814b700 con 0x7fdd6814b150 2024-04-26T22:21:31.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.024+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd5001f460 con 0x7fdd6814b150 2024-04-26T22:21:31.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.024+0000 7fdd64c00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 0x7fdd4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.024+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdd50089ab0 con 0x7fdd6814b150 2024-04-26T22:21:31.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.024+0000 7fdd67e00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 0x7fdd4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.024+0000 7fdd67e00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 0x7fdd4406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd580093f0 tx=0x7fdd58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.028+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd50059a10 con 0x7fdd6814b150 2024-04-26T22:21:31.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.188+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd68069530 con 0x7fdd44068380 2024-04-26T22:21:31.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.196+0000 7fdd64c00640 1 -- 172.21.15.16:0/2640047626 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fdd68069530 con 0x7fdd44068380 2024-04-26T22:21:31.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:31.202 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:21:31.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 msgr2=0x7fdd4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 0x7fdd4406a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd580093f0 tx=0x7fdd58008040 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 msgr2=0x7fdd681443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd50011840 tx=0x7fdd50011d00 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 shutdown_connections 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd44068380 0x7fdd4406a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd6814c6a0 0x7fdd681e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd6814b150 0x7fdd681443b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 --2- 172.21.15.16:0/2640047626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c004d50 0x7fdd68143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 >> 172.21.15.16:0/2640047626 conn(0x7fdd680bab10 msgr2=0x7fdd680b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 shutdown_connections 2024-04-26T22:21:31.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.200+0000 7fdd6ea00640 1 -- 172.21.15.16:0/2640047626 wait complete. 2024-04-26T22:21:31.221 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T22:21:30.102925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248252,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726468,"statfs":{"total":773094113280,"available":772839903232,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296939+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:24.296939+0000","last_peered":"2024-04-26T22:21:24.296939+0000","last_clean":"2024-04-26T22:21:24.296939+0000","last_became_active":"2024-04-26T22:21:22.404969+0000","last_became_peered":"2024-04-26T22:21:22.404969+0000","last_unstale":"2024-04-26T22:21:24.296939+0000","last_undegraded":"2024-04-26T22:21:24.296939+0000","last_fullsized":"2024-04-26T22:21:24.296939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:15.073482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412521+0000","last_change":"2024-04-26T22:21:22.419853+0000","last_active":"2024-04-26T22:21:23.412521+0000","last_peered":"2024-04-26T22:21:23.412521+0000","last_clean":"2024-04-26T22:21:23.412521+0000","last_became_active":"2024-04-26T22:21:22.419507+0000","last_became_peered":"2024-04-26T22:21:22.419507+0000","last_unstale":"2024-04-26T22:21:23.412521+0000","last_undegraded":"2024-04-26T22:21:23.412521+0000","last_fullsized":"2024-04-26T22:21:23.412521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297702+0000","last_change":"2024-04-26T22:21:22.402773+0000","last_active":"2024-04-26T22:21:24.297702+0000","last_peered":"2024-04-26T22:21:24.297702+0000","last_clean":"2024-04-26T22:21:24.297702+0000","last_became_active":"2024-04-26T22:21:22.402398+0000","last_became_peered":"2024-04-26T22:21:22.402398+0000","last_unstale":"2024-04-26T22:21:24.297702+0000","last_undegraded":"2024-04-26T22:21:24.297702+0000","last_fullsized":"2024-04-26T22:21:24.297702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.611708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203866+0000","last_change":"2024-04-26T22:21:22.419823+0000","last_active":"2024-04-26T22:21:24.203866+0000","last_peered":"2024-04-26T22:21:24.203866+0000","last_clean":"2024-04-26T22:21:24.203866+0000","last_became_active":"2024-04-26T22:21:22.419566+0000","last_became_peered":"2024-04-26T22:21:22.419566+0000","last_unstale":"2024-04-26T22:21:24.203866+0000","last_undegraded":"2024-04-26T22:21:24.203866+0000","last_fullsized":"2024-04-26T22:21:24.203866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:43.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296555+0000","last_change":"2024-04-26T22:21:22.406403+0000","last_active":"2024-04-26T22:21:24.296555+0000","last_peered":"2024-04-26T22:21:24.296555+0000","last_clean":"2024-04-26T22:21:24.296555+0000","last_became_active":"2024-04-26T22:21:22.406043+0000","last_became_peered":"2024-04-26T22:21:22.406043+0000","last_unstale":"2024-04-26T22:21:24.296555+0000","last_undegraded":"2024-04-26T22:21:24.296555+0000","last_fullsized":"2024-04-26T22:21:24.296555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:43.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203595+0000","last_change":"2024-04-26T22:21:22.414425+0000","last_active":"2024-04-26T22:21:24.203595+0000","last_peered":"2024-04-26T22:21:24.203595+0000","last_clean":"2024-04-26T22:21:24.203595+0000","last_became_active":"2024-04-26T22:21:22.414091+0000","last_became_peered":"2024-04-26T22:21:22.414091+0000","last_unstale":"2024-04-26T22:21:24.203595+0000","last_undegraded":"2024-04-26T22:21:24.203595+0000","last_fullsized":"2024-04-26T22:21:24.203595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296402+0000","last_change":"2024-04-26T22:21:22.416374+0000","last_active":"2024-04-26T22:21:24.296402+0000","last_peered":"2024-04-26T22:21:24.296402+0000","last_clean":"2024-04-26T22:21:24.296402+0000","last_became_active":"2024-04-26T22:21:22.415971+0000","last_became_peered":"2024-04-26T22:21:22.415971+0000","last_unstale":"2024-04-26T22:21:24.296402+0000","last_undegraded":"2024-04-26T22:21:24.296402+0000","last_fullsized":"2024-04-26T22:21:24.296402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268052+0000","last_change":"2024-04-26T22:21:22.426064+0000","last_active":"2024-04-26T22:21:24.268052+0000","last_peered":"2024-04-26T22:21:24.268052+0000","last_clean":"2024-04-26T22:21:24.268052+0000","last_became_active":"2024-04-26T22:21:22.425772+0000","last_became_peered":"2024-04-26T22:21:22.425772+0000","last_unstale":"2024-04-26T22:21:24.268052+0000","last_undegraded":"2024-04-26T22:21:24.268052+0000","last_fullsized":"2024-04-26T22:21:24.268052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297065+0000","last_change":"2024-04-26T22:21:22.419613+0000","last_active":"2024-04-26T22:21:24.297065+0000","last_peered":"2024-04-26T22:21:24.297065+0000","last_clean":"2024-04-26T22:21:24.297065+0000","last_became_active":"2024-04-26T22:21:22.419007+0000","last_became_peered":"2024-04-26T22:21:22.419007+0000","last_unstale":"2024-04-26T22:21:24.297065+0000","last_undegraded":"2024-04-26T22:21:24.297065+0000","last_fullsized":"2024-04-26T22:21:24.297065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:16.311995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409029+0000","last_change":"2024-04-26T22:21:22.423811+0000","last_active":"2024-04-26T22:21:23.409029+0000","last_peered":"2024-04-26T22:21:23.409029+0000","last_clean":"2024-04-26T22:21:23.409029+0000","last_became_active":"2024-04-26T22:21:22.418209+0000","last_became_peered":"2024-04-26T22:21:22.418209+0000","last_unstale":"2024-04-26T22:21:23.409029+0000","last_undegraded":"2024-04-26T22:21:23.409029+0000","last_fullsized":"2024-04-26T22:21:23.409029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408471+0000","last_change":"2024-04-26T22:21:22.417717+0000","last_active":"2024-04-26T22:21:23.408471+0000","last_peered":"2024-04-26T22:21:23.408471+0000","last_clean":"2024-04-26T22:21:23.408471+0000","last_became_active":"2024-04-26T22:21:22.417411+0000","last_became_peered":"2024-04-26T22:21:22.417411+0000","last_unstale":"2024-04-26T22:21:23.408471+0000","last_undegraded":"2024-04-26T22:21:23.408471+0000","last_fullsized":"2024-04-26T22:21:23.408471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409203+0000","last_change":"2024-04-26T22:21:22.399958+0000","last_active":"2024-04-26T22:21:23.409203+0000","last_peered":"2024-04-26T22:21:23.409203+0000","last_clean":"2024-04-26T22:21:23.409203+0000","last_became_active":"2024-04-26T22:21:22.398263+0000","last_became_peered":"2024-04-26T22:21:22.398263+0000","last_unstale":"2024-04-26T22:21:23.409203+0000","last_undegraded":"2024-04-26T22:21:23.409203+0000","last_fullsized":"2024-04-26T22:21:23.409203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268272+0000","last_change":"2024-04-26T22:21:22.401315+0000","last_active":"2024-04-26T22:21:24.268272+0000","last_peered":"2024-04-26T22:21:24.268272+0000","last_clean":"2024-04-26T22:21:24.268272+0000","last_became_active":"2024-04-26T22:21:22.401055+0000","last_became_peered":"2024-04-26T22:21:22.401055+0000","last_unstale":"2024-04-26T22:21:24.268272+0000","last_undegraded":"2024-04-26T22:21:24.268272+0000","last_fullsized":"2024-04-26T22:21:24.268272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297345+0000","last_change":"2024-04-26T22:21:22.401017+0000","last_active":"2024-04-26T22:21:24.297345+0000","last_peered":"2024-04-26T22:21:24.297345+0000","last_clean":"2024-04-26T22:21:24.297345+0000","last_became_active":"2024-04-26T22:21:22.400740+0000","last_became_peered":"2024-04-26T22:21:22.400740+0000","last_unstale":"2024-04-26T22:21:24.297345+0000","last_undegraded":"2024-04-26T22:21:24.297345+0000","last_fullsized":"2024-04-26T22:21:24.297345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:02.215791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412340+0000","last_change":"2024-04-26T22:21:22.391216+0000","last_active":"2024-04-26T22:21:23.412340+0000","last_peered":"2024-04-26T22:21:23.412340+0000","last_clean":"2024-04-26T22:21:23.412340+0000","last_became_active":"2024-04-26T22:21:22.390914+0000","last_became_peered":"2024-04-26T22:21:22.390914+0000","last_unstale":"2024-04-26T22:21:23.412340+0000","last_undegraded":"2024-04-26T22:21:23.412340+0000","last_fullsized":"2024-04-26T22:21:23.412340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203419+0000","last_change":"2024-04-26T22:21:22.415179+0000","last_active":"2024-04-26T22:21:24.203419+0000","last_peered":"2024-04-26T22:21:24.203419+0000","last_clean":"2024-04-26T22:21:24.203419+0000","last_became_active":"2024-04-26T22:21:22.414894+0000","last_became_peered":"2024-04-26T22:21:22.414894+0000","last_unstale":"2024-04-26T22:21:24.203419+0000","last_undegraded":"2024-04-26T22:21:24.203419+0000","last_fullsized":"2024-04-26T22:21:24.203419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204210+0000","last_change":"2024-04-26T22:21:22.414418+0000","last_active":"2024-04-26T22:21:24.204210+0000","last_peered":"2024-04-26T22:21:24.204210+0000","last_clean":"2024-04-26T22:21:24.204210+0000","last_became_active":"2024-04-26T22:21:22.413203+0000","last_became_peered":"2024-04-26T22:21:22.413203+0000","last_unstale":"2024-04-26T22:21:24.204210+0000","last_undegraded":"2024-04-26T22:21:24.204210+0000","last_fullsized":"2024-04-26T22:21:24.204210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:37.693100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408121+0000","last_change":"2024-04-26T22:21:22.406821+0000","last_active":"2024-04-26T22:21:23.408121+0000","last_peered":"2024-04-26T22:21:23.408121+0000","last_clean":"2024-04-26T22:21:23.408121+0000","last_became_active":"2024-04-26T22:21:22.406613+0000","last_became_peered":"2024-04-26T22:21:22.406613+0000","last_unstale":"2024-04-26T22:21:23.408121+0000","last_undegraded":"2024-04-26T22:21:23.408121+0000","last_fullsized":"2024-04-26T22:21:23.408121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296977+0000","last_change":"2024-04-26T22:21:22.410515+0000","last_active":"2024-04-26T22:21:24.296977+0000","last_peered":"2024-04-26T22:21:24.296977+0000","last_clean":"2024-04-26T22:21:24.296977+0000","last_became_active":"2024-04-26T22:21:22.410219+0000","last_became_peered":"2024-04-26T22:21:22.410219+0000","last_unstale":"2024-04-26T22:21:24.296977+0000","last_undegraded":"2024-04-26T22:21:24.296977+0000","last_fullsized":"2024-04-26T22:21:24.296977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:25.382692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409256+0000","last_change":"2024-04-26T22:21:22.407928+0000","last_active":"2024-04-26T22:21:23.409256+0000","last_peered":"2024-04-26T22:21:23.409256+0000","last_clean":"2024-04-26T22:21:23.409256+0000","last_became_active":"2024-04-26T22:21:22.407586+0000","last_became_peered":"2024-04-26T22:21:22.407586+0000","last_unstale":"2024-04-26T22:21:23.409256+0000","last_undegraded":"2024-04-26T22:21:23.409256+0000","last_fullsized":"2024-04-26T22:21:23.409256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297513+0000","last_change":"2024-04-26T22:21:22.415479+0000","last_active":"2024-04-26T22:21:24.297513+0000","last_peered":"2024-04-26T22:21:24.297513+0000","last_clean":"2024-04-26T22:21:24.297513+0000","last_became_active":"2024-04-26T22:21:22.415221+0000","last_became_peered":"2024-04-26T22:21:22.415221+0000","last_unstale":"2024-04-26T22:21:24.297513+0000","last_undegraded":"2024-04-26T22:21:24.297513+0000","last_fullsized":"2024-04-26T22:21:24.297513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:39:06.935658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203562+0000","last_change":"2024-04-26T22:21:22.412956+0000","last_active":"2024-04-26T22:21:24.203562+0000","last_peered":"2024-04-26T22:21:24.203562+0000","last_clean":"2024-04-26T22:21:24.203562+0000","last_became_active":"2024-04-26T22:21:22.412717+0000","last_became_peered":"2024-04-26T22:21:22.412717+0000","last_unstale":"2024-04-26T22:21:24.203562+0000","last_undegraded":"2024-04-26T22:21:24.203562+0000","last_fullsized":"2024-04-26T22:21:24.203562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268197+0000","last_change":"2024-04-26T22:21:22.410307+0000","last_active":"2024-04-26T22:21:24.268197+0000","last_peered":"2024-04-26T22:21:24.268197+0000","last_clean":"2024-04-26T22:21:24.268197+0000","last_became_active":"2024-04-26T22:21:22.410111+0000","last_became_peered":"2024-04-26T22:21:22.410111+0000","last_unstale":"2024-04-26T22:21:24.268197+0000","last_undegraded":"2024-04-26T22:21:24.268197+0000","last_fullsized":"2024-04-26T22:21:24.268197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203611+0000","last_change":"2024-04-26T22:21:22.427712+0000","last_active":"2024-04-26T22:21:24.203611+0000","last_peered":"2024-04-26T22:21:24.203611+0000","last_clean":"2024-04-26T22:21:24.203611+0000","last_became_active":"2024-04-26T22:21:22.427358+0000","last_became_peered":"2024-04-26T22:21:22.427358+0000","last_unstale":"2024-04-26T22:21:24.203611+0000","last_undegraded":"2024-04-26T22:21:24.203611+0000","last_fullsized":"2024-04-26T22:21:24.203611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268627+0000","last_change":"2024-04-26T22:21:22.412148+0000","last_active":"2024-04-26T22:21:24.268627+0000","last_peered":"2024-04-26T22:21:24.268627+0000","last_clean":"2024-04-26T22:21:24.268627+0000","last_became_active":"2024-04-26T22:21:22.411380+0000","last_became_peered":"2024-04-26T22:21:22.411380+0000","last_unstale":"2024-04-26T22:21:24.268627+0000","last_undegraded":"2024-04-26T22:21:24.268627+0000","last_fullsized":"2024-04-26T22:21:24.268627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409175+0000","last_change":"2024-04-26T22:21:22.412872+0000","last_active":"2024-04-26T22:21:23.409175+0000","last_peered":"2024-04-26T22:21:23.409175+0000","last_clean":"2024-04-26T22:21:23.409175+0000","last_became_active":"2024-04-26T22:21:22.412429+0000","last_became_peered":"2024-04-26T22:21:22.412429+0000","last_unstale":"2024-04-26T22:21:23.409175+0000","last_undegraded":"2024-04-26T22:21:23.409175+0000","last_fullsized":"2024-04-26T22:21:23.409175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412454+0000","last_change":"2024-04-26T22:21:22.403344+0000","last_active":"2024-04-26T22:21:23.412454+0000","last_peered":"2024-04-26T22:21:23.412454+0000","last_clean":"2024-04-26T22:21:23.412454+0000","last_became_active":"2024-04-26T22:21:22.403042+0000","last_became_peered":"2024-04-26T22:21:22.403042+0000","last_unstale":"2024-04-26T22:21:23.412454+0000","last_undegraded":"2024-04-26T22:21:23.412454+0000","last_fullsized":"2024-04-26T22:21:23.412454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268583+0000","last_change":"2024-04-26T22:21:22.411698+0000","last_active":"2024-04-26T22:21:24.268583+0000","last_peered":"2024-04-26T22:21:24.268583+0000","last_clean":"2024-04-26T22:21:24.268583+0000","last_became_active":"2024-04-26T22:21:22.410959+0000","last_became_peered":"2024-04-26T22:21:22.410959+0000","last_unstale":"2024-04-26T22:21:24.268583+0000","last_undegraded":"2024-04-26T22:21:24.268583+0000","last_fullsized":"2024-04-26T22:21:24.268583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297636+0000","last_change":"2024-04-26T22:21:22.414909+0000","last_active":"2024-04-26T22:21:24.297636+0000","last_peered":"2024-04-26T22:21:24.297636+0000","last_clean":"2024-04-26T22:21:24.297636+0000","last_became_active":"2024-04-26T22:21:22.412967+0000","last_became_peered":"2024-04-26T22:21:22.412967+0000","last_unstale":"2024-04-26T22:21:24.297636+0000","last_undegraded":"2024-04-26T22:21:24.297636+0000","last_fullsized":"2024-04-26T22:21:24.297636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:04.915714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203788+0000","last_change":"2024-04-26T22:21:22.412771+0000","last_active":"2024-04-26T22:21:24.203788+0000","last_peered":"2024-04-26T22:21:24.203788+0000","last_clean":"2024-04-26T22:21:24.203788+0000","last_became_active":"2024-04-26T22:21:22.412269+0000","last_became_peered":"2024-04-26T22:21:22.412269+0000","last_unstale":"2024-04-26T22:21:24.203788+0000","last_undegraded":"2024-04-26T22:21:24.203788+0000","last_fullsized":"2024-04-26T22:21:24.203788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408052+0000","last_change":"2024-04-26T22:21:22.420475+0000","last_active":"2024-04-26T22:21:23.408052+0000","last_peered":"2024-04-26T22:21:23.408052+0000","last_clean":"2024-04-26T22:21:23.408052+0000","last_became_active":"2024-04-26T22:21:22.420224+0000","last_became_peered":"2024-04-26T22:21:22.420224+0000","last_unstale":"2024-04-26T22:21:23.408052+0000","last_undegraded":"2024-04-26T22:21:23.408052+0000","last_fullsized":"2024-04-26T22:21:23.408052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408065+0000","last_change":"2024-04-26T22:21:22.417961+0000","last_active":"2024-04-26T22:21:23.408065+0000","last_peered":"2024-04-26T22:21:23.408065+0000","last_clean":"2024-04-26T22:21:23.408065+0000","last_became_active":"2024-04-26T22:21:22.417173+0000","last_became_peered":"2024-04-26T22:21:22.417173+0000","last_unstale":"2024-04-26T22:21:23.408065+0000","last_undegraded":"2024-04-26T22:21:23.408065+0000","last_fullsized":"2024-04-26T22:21:23.408065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409653+0000","last_change":"2024-04-26T22:21:22.399070+0000","last_active":"2024-04-26T22:21:23.409653+0000","last_peered":"2024-04-26T22:21:23.409653+0000","last_clean":"2024-04-26T22:21:23.409653+0000","last_became_active":"2024-04-26T22:21:22.398182+0000","last_became_peered":"2024-04-26T22:21:22.398182+0000","last_unstale":"2024-04-26T22:21:23.409653+0000","last_undegraded":"2024-04-26T22:21:23.409653+0000","last_fullsized":"2024-04-26T22:21:23.409653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268411+0000","last_change":"2024-04-26T22:21:21.400248+0000","last_active":"2024-04-26T22:21:24.268411+0000","last_peered":"2024-04-26T22:21:24.268411+0000","last_clean":"2024-04-26T22:21:24.268411+0000","last_became_active":"2024-04-26T22:21:21.399953+0000","last_became_peered":"2024-04-26T22:21:21.399953+0000","last_unstale":"2024-04-26T22:21:24.268411+0000","last_undegraded":"2024-04-26T22:21:24.268411+0000","last_fullsized":"2024-04-26T22:21:24.268411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297720+0000","last_change":"2024-04-26T22:21:22.414633+0000","last_active":"2024-04-26T22:21:24.297720+0000","last_peered":"2024-04-26T22:21:24.297720+0000","last_clean":"2024-04-26T22:21:24.297720+0000","last_became_active":"2024-04-26T22:21:22.414387+0000","last_became_peered":"2024-04-26T22:21:22.414387+0000","last_unstale":"2024-04-26T22:21:24.297720+0000","last_undegraded":"2024-04-26T22:21:24.297720+0000","last_fullsized":"2024-04-26T22:21:24.297720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:20.041652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408260+0000","last_change":"2024-04-26T22:21:21.400875+0000","last_active":"2024-04-26T22:21:23.408260+0000","last_peered":"2024-04-26T22:21:23.408260+0000","last_clean":"2024-04-26T22:21:23.408260+0000","last_became_active":"2024-04-26T22:21:21.400561+0000","last_became_peered":"2024-04-26T22:21:21.400561+0000","last_unstale":"2024-04-26T22:21:23.408260+0000","last_undegraded":"2024-04-26T22:21:23.408260+0000","last_fullsized":"2024-04-26T22:21:23.408260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268273+0000","last_change":"2024-04-26T22:21:21.395724+0000","last_active":"2024-04-26T22:21:24.268273+0000","last_peered":"2024-04-26T22:21:24.268273+0000","last_clean":"2024-04-26T22:21:24.268273+0000","last_became_active":"2024-04-26T22:21:21.395270+0000","last_became_peered":"2024-04-26T22:21:21.395270+0000","last_unstale":"2024-04-26T22:21:24.268273+0000","last_undegraded":"2024-04-26T22:21:24.268273+0000","last_fullsized":"2024-04-26T22:21:24.268273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268116+0000","last_change":"2024-04-26T22:21:22.425600+0000","last_active":"2024-04-26T22:21:24.268116+0000","last_peered":"2024-04-26T22:21:24.268116+0000","last_clean":"2024-04-26T22:21:24.268116+0000","last_became_active":"2024-04-26T22:21:22.420621+0000","last_became_peered":"2024-04-26T22:21:22.420621+0000","last_unstale":"2024-04-26T22:21:24.268116+0000","last_undegraded":"2024-04-26T22:21:24.268116+0000","last_fullsized":"2024-04-26T22:21:24.268116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203584+0000","last_change":"2024-04-26T22:21:21.396563+0000","last_active":"2024-04-26T22:21:24.203584+0000","last_peered":"2024-04-26T22:21:24.203584+0000","last_clean":"2024-04-26T22:21:24.203584+0000","last_became_active":"2024-04-26T22:21:21.393730+0000","last_became_peered":"2024-04-26T22:21:21.393730+0000","last_unstale":"2024-04-26T22:21:24.203584+0000","last_undegraded":"2024-04-26T22:21:24.203584+0000","last_fullsized":"2024-04-26T22:21:24.203584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412421+0000","last_change":"2024-04-26T22:21:22.399913+0000","last_active":"2024-04-26T22:21:23.412421+0000","last_peered":"2024-04-26T22:21:23.412421+0000","last_clean":"2024-04-26T22:21:23.412421+0000","last_became_active":"2024-04-26T22:21:22.399633+0000","last_became_peered":"2024-04-26T22:21:22.399633+0000","last_unstale":"2024-04-26T22:21:23.412421+0000","last_undegraded":"2024-04-26T22:21:23.412421+0000","last_fullsized":"2024-04-26T22:21:23.412421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408864+0000","last_change":"2024-04-26T22:21:21.401808+0000","last_active":"2024-04-26T22:21:23.408864+0000","last_peered":"2024-04-26T22:21:23.408864+0000","last_clean":"2024-04-26T22:21:23.408864+0000","last_became_active":"2024-04-26T22:21:21.401323+0000","last_became_peered":"2024-04-26T22:21:21.401323+0000","last_unstale":"2024-04-26T22:21:23.408864+0000","last_undegraded":"2024-04-26T22:21:23.408864+0000","last_fullsized":"2024-04-26T22:21:23.408864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203974+0000","last_change":"2024-04-26T22:21:22.416004+0000","last_active":"2024-04-26T22:21:24.203974+0000","last_peered":"2024-04-26T22:21:24.203974+0000","last_clean":"2024-04-26T22:21:24.203974+0000","last_became_active":"2024-04-26T22:21:22.415730+0000","last_became_peered":"2024-04-26T22:21:22.415730+0000","last_unstale":"2024-04-26T22:21:24.203974+0000","last_undegraded":"2024-04-26T22:21:24.203974+0000","last_fullsized":"2024-04-26T22:21:24.203974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:05.885186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203957+0000","last_change":"2024-04-26T22:21:21.403091+0000","last_active":"2024-04-26T22:21:24.203957+0000","last_peered":"2024-04-26T22:21:24.203957+0000","last_clean":"2024-04-26T22:21:24.203957+0000","last_became_active":"2024-04-26T22:21:21.402767+0000","last_became_peered":"2024-04-26T22:21:21.402767+0000","last_unstale":"2024-04-26T22:21:24.203957+0000","last_undegraded":"2024-04-26T22:21:24.203957+0000","last_fullsized":"2024-04-26T22:21:24.203957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297940+0000","last_change":"2024-04-26T22:21:22.421952+0000","last_active":"2024-04-26T22:21:24.297940+0000","last_peered":"2024-04-26T22:21:24.297940+0000","last_clean":"2024-04-26T22:21:24.297940+0000","last_became_active":"2024-04-26T22:21:22.421689+0000","last_became_peered":"2024-04-26T22:21:22.421689+0000","last_unstale":"2024-04-26T22:21:24.297940+0000","last_undegraded":"2024-04-26T22:21:24.297940+0000","last_fullsized":"2024-04-26T22:21:24.297940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:08.627275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412426+0000","last_change":"2024-04-26T22:21:21.410257+0000","last_active":"2024-04-26T22:21:23.412426+0000","last_peered":"2024-04-26T22:21:23.412426+0000","last_clean":"2024-04-26T22:21:23.412426+0000","last_became_active":"2024-04-26T22:21:21.409894+0000","last_became_peered":"2024-04-26T22:21:21.409894+0000","last_unstale":"2024-04-26T22:21:23.412426+0000","last_undegraded":"2024-04-26T22:21:23.412426+0000","last_fullsized":"2024-04-26T22:21:23.412426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409320+0000","last_change":"2024-04-26T22:21:22.404687+0000","last_active":"2024-04-26T22:21:23.409320+0000","last_peered":"2024-04-26T22:21:23.409320+0000","last_clean":"2024-04-26T22:21:23.409320+0000","last_became_active":"2024-04-26T22:21:22.404406+0000","last_became_peered":"2024-04-26T22:21:22.404406+0000","last_unstale":"2024-04-26T22:21:23.409320+0000","last_undegraded":"2024-04-26T22:21:23.409320+0000","last_fullsized":"2024-04-26T22:21:23.409320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409406+0000","last_change":"2024-04-26T22:21:21.390689+0000","last_active":"2024-04-26T22:21:23.409406+0000","last_peered":"2024-04-26T22:21:23.409406+0000","last_clean":"2024-04-26T22:21:23.409406+0000","last_became_active":"2024-04-26T22:21:21.390404+0000","last_became_peered":"2024-04-26T22:21:21.390404+0000","last_unstale":"2024-04-26T22:21:23.409406+0000","last_undegraded":"2024-04-26T22:21:23.409406+0000","last_fullsized":"2024-04-26T22:21:23.409406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296716+0000","last_change":"2024-04-26T22:21:22.407190+0000","last_active":"2024-04-26T22:21:24.296716+0000","last_peered":"2024-04-26T22:21:24.296716+0000","last_clean":"2024-04-26T22:21:24.296716+0000","last_became_active":"2024-04-26T22:21:22.406951+0000","last_became_peered":"2024-04-26T22:21:22.406951+0000","last_unstale":"2024-04-26T22:21:24.296716+0000","last_undegraded":"2024-04-26T22:21:24.296716+0000","last_fullsized":"2024-04-26T22:21:24.296716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:05.885186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297788+0000","last_change":"2024-04-26T22:21:21.392411+0000","last_active":"2024-04-26T22:21:24.297788+0000","last_peered":"2024-04-26T22:21:24.297788+0000","last_clean":"2024-04-26T22:21:24.297788+0000","last_became_active":"2024-04-26T22:21:21.392091+0000","last_became_peered":"2024-04-26T22:21:21.392091+0000","last_unstale":"2024-04-26T22:21:24.297788+0000","last_undegraded":"2024-04-26T22:21:24.297788+0000","last_fullsized":"2024-04-26T22:21:24.297788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:39.738654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297490+0000","last_change":"2024-04-26T22:21:22.415923+0000","last_active":"2024-04-26T22:21:24.297490+0000","last_peered":"2024-04-26T22:21:24.297490+0000","last_clean":"2024-04-26T22:21:24.297490+0000","last_became_active":"2024-04-26T22:21:22.415523+0000","last_became_peered":"2024-04-26T22:21:22.415523+0000","last_unstale":"2024-04-26T22:21:24.297490+0000","last_undegraded":"2024-04-26T22:21:24.297490+0000","last_fullsized":"2024-04-26T22:21:24.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:23.620856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203791+0000","last_change":"2024-04-26T22:21:21.397039+0000","last_active":"2024-04-26T22:21:24.203791+0000","last_peered":"2024-04-26T22:21:24.203791+0000","last_clean":"2024-04-26T22:21:24.203791+0000","last_became_active":"2024-04-26T22:21:21.395448+0000","last_became_peered":"2024-04-26T22:21:21.395448+0000","last_unstale":"2024-04-26T22:21:24.203791+0000","last_undegraded":"2024-04-26T22:21:24.203791+0000","last_fullsized":"2024-04-26T22:21:24.203791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296625+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:24.296625+0000","last_peered":"2024-04-26T22:21:24.296625+0000","last_clean":"2024-04-26T22:21:24.296625+0000","last_became_active":"2024-04-26T22:21:22.406210+0000","last_became_peered":"2024-04-26T22:21:22.406210+0000","last_unstale":"2024-04-26T22:21:24.296625+0000","last_undegraded":"2024-04-26T22:21:24.296625+0000","last_fullsized":"2024-04-26T22:21:24.296625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:08.480631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408048+0000","last_change":"2024-04-26T22:21:21.395875+0000","last_active":"2024-04-26T22:21:23.408048+0000","last_peered":"2024-04-26T22:21:23.408048+0000","last_clean":"2024-04-26T22:21:23.408048+0000","last_became_active":"2024-04-26T22:21:21.395537+0000","last_became_peered":"2024-04-26T22:21:21.395537+0000","last_unstale":"2024-04-26T22:21:23.408048+0000","last_undegraded":"2024-04-26T22:21:23.408048+0000","last_fullsized":"2024-04-26T22:21:23.408048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409338+0000","last_change":"2024-04-26T22:21:22.401767+0000","last_active":"2024-04-26T22:21:23.409338+0000","last_peered":"2024-04-26T22:21:23.409338+0000","last_clean":"2024-04-26T22:21:23.409338+0000","last_became_active":"2024-04-26T22:21:22.401447+0000","last_became_peered":"2024-04-26T22:21:22.401447+0000","last_unstale":"2024-04-26T22:21:23.409338+0000","last_undegraded":"2024-04-26T22:21:23.409338+0000","last_fullsized":"2024-04-26T22:21:23.409338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.407992+0000","last_change":"2024-04-26T22:21:21.403885+0000","last_active":"2024-04-26T22:21:23.407992+0000","last_peered":"2024-04-26T22:21:23.407992+0000","last_clean":"2024-04-26T22:21:23.407992+0000","last_became_active":"2024-04-26T22:21:21.403438+0000","last_became_peered":"2024-04-26T22:21:21.403438+0000","last_unstale":"2024-04-26T22:21:23.407992+0000","last_undegraded":"2024-04-26T22:21:23.407992+0000","last_fullsized":"2024-04-26T22:21:23.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296482+0000","last_change":"2024-04-26T22:21:22.411158+0000","last_active":"2024-04-26T22:21:24.296482+0000","last_peered":"2024-04-26T22:21:24.296482+0000","last_clean":"2024-04-26T22:21:24.296482+0000","last_became_active":"2024-04-26T22:21:22.410853+0000","last_became_peered":"2024-04-26T22:21:22.410853+0000","last_unstale":"2024-04-26T22:21:24.296482+0000","last_undegraded":"2024-04-26T22:21:24.296482+0000","last_fullsized":"2024-04-26T22:21:24.296482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408979+0000","last_change":"2024-04-26T22:21:21.392442+0000","last_active":"2024-04-26T22:21:23.408979+0000","last_peered":"2024-04-26T22:21:23.408979+0000","last_clean":"2024-04-26T22:21:23.408979+0000","last_became_active":"2024-04-26T22:21:21.389407+0000","last_became_peered":"2024-04-26T22:21:21.389407+0000","last_unstale":"2024-04-26T22:21:23.408979+0000","last_undegraded":"2024-04-26T22:21:23.408979+0000","last_fullsized":"2024-04-26T22:21:23.408979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.950669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296957+0000","last_change":"2024-04-26T22:21:22.406366+0000","last_active":"2024-04-26T22:21:24.296957+0000","last_peered":"2024-04-26T22:21:24.296957+0000","last_clean":"2024-04-26T22:21:24.296957+0000","last_became_active":"2024-04-26T22:21:22.406094+0000","last_became_peered":"2024-04-26T22:21:22.406094+0000","last_unstale":"2024-04-26T22:21:24.296957+0000","last_undegraded":"2024-04-26T22:21:24.296957+0000","last_fullsized":"2024-04-26T22:21:24.296957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:37.693100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408162+0000","last_change":"2024-04-26T22:21:21.396566+0000","last_active":"2024-04-26T22:21:23.408162+0000","last_peered":"2024-04-26T22:21:23.408162+0000","last_clean":"2024-04-26T22:21:23.408162+0000","last_became_active":"2024-04-26T22:21:21.396207+0000","last_became_peered":"2024-04-26T22:21:21.396207+0000","last_unstale":"2024-04-26T22:21:23.408162+0000","last_undegraded":"2024-04-26T22:21:23.408162+0000","last_fullsized":"2024-04-26T22:21:23.408162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297059+0000","last_change":"2024-04-26T22:21:22.405977+0000","last_active":"2024-04-26T22:21:24.297059+0000","last_peered":"2024-04-26T22:21:24.297059+0000","last_clean":"2024-04-26T22:21:24.297059+0000","last_became_active":"2024-04-26T22:21:22.405645+0000","last_became_peered":"2024-04-26T22:21:22.405645+0000","last_unstale":"2024-04-26T22:21:24.297059+0000","last_undegraded":"2024-04-26T22:21:24.297059+0000","last_fullsized":"2024-04-26T22:21:24.297059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:11.511211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412572+0000","last_change":"2024-04-26T22:21:21.405545+0000","last_active":"2024-04-26T22:21:23.412572+0000","last_peered":"2024-04-26T22:21:23.412572+0000","last_clean":"2024-04-26T22:21:23.412572+0000","last_became_active":"2024-04-26T22:21:21.403284+0000","last_became_peered":"2024-04-26T22:21:21.403284+0000","last_unstale":"2024-04-26T22:21:23.412572+0000","last_undegraded":"2024-04-26T22:21:23.412572+0000","last_fullsized":"2024-04-26T22:21:23.412572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204151+0000","last_change":"2024-04-26T22:21:22.415709+0000","last_active":"2024-04-26T22:21:24.204151+0000","last_peered":"2024-04-26T22:21:24.204151+0000","last_clean":"2024-04-26T22:21:24.204151+0000","last_became_active":"2024-04-26T22:21:22.414839+0000","last_became_peered":"2024-04-26T22:21:22.414839+0000","last_unstale":"2024-04-26T22:21:24.204151+0000","last_undegraded":"2024-04-26T22:21:24.204151+0000","last_fullsized":"2024-04-26T22:21:24.204151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:15.073482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408107+0000","last_change":"2024-04-26T22:21:21.397699+0000","last_active":"2024-04-26T22:21:23.408107+0000","last_peered":"2024-04-26T22:21:23.408107+0000","last_clean":"2024-04-26T22:21:23.408107+0000","last_became_active":"2024-04-26T22:21:21.397372+0000","last_became_peered":"2024-04-26T22:21:21.397372+0000","last_unstale":"2024-04-26T22:21:23.408107+0000","last_undegraded":"2024-04-26T22:21:23.408107+0000","last_fullsized":"2024-04-26T22:21:23.408107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296770+0000","last_change":"2024-04-26T22:21:22.420982+0000","last_active":"2024-04-26T22:21:24.296770+0000","last_peered":"2024-04-26T22:21:24.296770+0000","last_clean":"2024-04-26T22:21:24.296770+0000","last_became_active":"2024-04-26T22:21:22.420729+0000","last_became_peered":"2024-04-26T22:21:22.420729+0000","last_unstale":"2024-04-26T22:21:24.296770+0000","last_undegraded":"2024-04-26T22:21:24.296770+0000","last_fullsized":"2024-04-26T22:21:24.296770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.095762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296334+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:21:24.296334+0000","last_peered":"2024-04-26T22:21:24.296334+0000","last_clean":"2024-04-26T22:21:24.296334+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:21:24.296334+0000","last_undegraded":"2024-04-26T22:21:24.296334+0000","last_fullsized":"2024-04-26T22:21:24.296334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203426+0000","last_change":"2024-04-26T22:21:21.400430+0000","last_active":"2024-04-26T22:21:24.203426+0000","last_peered":"2024-04-26T22:21:24.203426+0000","last_clean":"2024-04-26T22:21:24.203426+0000","last_became_active":"2024-04-26T22:21:21.400160+0000","last_became_peered":"2024-04-26T22:21:21.400160+0000","last_unstale":"2024-04-26T22:21:24.203426+0000","last_undegraded":"2024-04-26T22:21:24.203426+0000","last_fullsized":"2024-04-26T22:21:24.203426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268202+0000","last_change":"2024-04-26T22:21:22.427326+0000","last_active":"2024-04-26T22:21:24.268202+0000","last_peered":"2024-04-26T22:21:24.268202+0000","last_clean":"2024-04-26T22:21:24.268202+0000","last_became_active":"2024-04-26T22:21:22.427067+0000","last_became_peered":"2024-04-26T22:21:22.427067+0000","last_unstale":"2024-04-26T22:21:24.268202+0000","last_undegraded":"2024-04-26T22:21:24.268202+0000","last_fullsized":"2024-04-26T22:21:24.268202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296218+0000","last_change":"2024-04-26T22:21:21.407696+0000","last_active":"2024-04-26T22:21:24.296218+0000","last_peered":"2024-04-26T22:21:24.296218+0000","last_clean":"2024-04-26T22:21:24.296218+0000","last_became_active":"2024-04-26T22:21:21.406397+0000","last_became_peered":"2024-04-26T22:21:21.406397+0000","last_unstale":"2024-04-26T22:21:24.296218+0000","last_undegraded":"2024-04-26T22:21:24.296218+0000","last_fullsized":"2024-04-26T22:21:24.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:07.497430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297336+0000","last_change":"2024-04-26T22:21:22.413618+0000","last_active":"2024-04-26T22:21:24.297336+0000","last_peered":"2024-04-26T22:21:24.297336+0000","last_clean":"2024-04-26T22:21:24.297336+0000","last_became_active":"2024-04-26T22:21:22.413285+0000","last_became_peered":"2024-04-26T22:21:22.413285+0000","last_unstale":"2024-04-26T22:21:24.297336+0000","last_undegraded":"2024-04-26T22:21:24.297336+0000","last_fullsized":"2024-04-26T22:21:24.297336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:07.261333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408143+0000","last_change":"2024-04-26T22:21:21.392079+0000","last_active":"2024-04-26T22:21:23.408143+0000","last_peered":"2024-04-26T22:21:23.408143+0000","last_clean":"2024-04-26T22:21:23.408143+0000","last_became_active":"2024-04-26T22:21:21.391760+0000","last_became_peered":"2024-04-26T22:21:21.391760+0000","last_unstale":"2024-04-26T22:21:23.408143+0000","last_undegraded":"2024-04-26T22:21:23.408143+0000","last_fullsized":"2024-04-26T22:21:23.408143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412645+0000","last_change":"2024-04-26T22:21:22.392865+0000","last_active":"2024-04-26T22:21:23.412645+0000","last_peered":"2024-04-26T22:21:23.412645+0000","last_clean":"2024-04-26T22:21:23.412645+0000","last_became_active":"2024-04-26T22:21:22.392571+0000","last_became_peered":"2024-04-26T22:21:22.392571+0000","last_unstale":"2024-04-26T22:21:23.412645+0000","last_undegraded":"2024-04-26T22:21:23.412645+0000","last_fullsized":"2024-04-26T22:21:23.412645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203951+0000","last_change":"2024-04-26T22:21:21.402750+0000","last_active":"2024-04-26T22:21:24.203951+0000","last_peered":"2024-04-26T22:21:24.203951+0000","last_clean":"2024-04-26T22:21:24.203951+0000","last_became_active":"2024-04-26T22:21:21.402348+0000","last_became_peered":"2024-04-26T22:21:21.402348+0000","last_unstale":"2024-04-26T22:21:24.203951+0000","last_undegraded":"2024-04-26T22:21:24.203951+0000","last_fullsized":"2024-04-26T22:21:24.203951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409547+0000","last_change":"2024-04-26T22:21:22.418638+0000","last_active":"2024-04-26T22:21:23.409547+0000","last_peered":"2024-04-26T22:21:23.409547+0000","last_clean":"2024-04-26T22:21:23.409547+0000","last_became_active":"2024-04-26T22:21:22.418047+0000","last_became_peered":"2024-04-26T22:21:22.418047+0000","last_unstale":"2024-04-26T22:21:23.409547+0000","last_undegraded":"2024-04-26T22:21:23.409547+0000","last_fullsized":"2024-04-26T22:21:23.409547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412552+0000","last_change":"2024-04-26T22:21:21.404376+0000","last_active":"2024-04-26T22:21:23.412552+0000","last_peered":"2024-04-26T22:21:23.412552+0000","last_clean":"2024-04-26T22:21:23.412552+0000","last_became_active":"2024-04-26T22:21:21.404115+0000","last_became_peered":"2024-04-26T22:21:21.404115+0000","last_unstale":"2024-04-26T22:21:23.412552+0000","last_undegraded":"2024-04-26T22:21:23.412552+0000","last_fullsized":"2024-04-26T22:21:23.412552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204135+0000","last_change":"2024-04-26T22:21:22.419797+0000","last_active":"2024-04-26T22:21:24.204135+0000","last_peered":"2024-04-26T22:21:24.204135+0000","last_clean":"2024-04-26T22:21:24.204135+0000","last_became_active":"2024-04-26T22:21:22.414517+0000","last_became_peered":"2024-04-26T22:21:22.414517+0000","last_unstale":"2024-04-26T22:21:24.204135+0000","last_undegraded":"2024-04-26T22:21:24.204135+0000","last_fullsized":"2024-04-26T22:21:24.204135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.095762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296961+0000","last_change":"2024-04-26T22:21:21.405504+0000","last_active":"2024-04-26T22:21:24.296961+0000","last_peered":"2024-04-26T22:21:24.296961+0000","last_clean":"2024-04-26T22:21:24.296961+0000","last_became_active":"2024-04-26T22:21:21.405051+0000","last_became_peered":"2024-04-26T22:21:21.405051+0000","last_unstale":"2024-04-26T22:21:24.296961+0000","last_undegraded":"2024-04-26T22:21:24.296961+0000","last_fullsized":"2024-04-26T22:21:24.296961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:21.339836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412393+0000","last_change":"2024-04-26T22:21:22.392844+0000","last_active":"2024-04-26T22:21:23.412393+0000","last_peered":"2024-04-26T22:21:23.412393+0000","last_clean":"2024-04-26T22:21:23.412393+0000","last_became_active":"2024-04-26T22:21:22.392544+0000","last_became_peered":"2024-04-26T22:21:22.392544+0000","last_unstale":"2024-04-26T22:21:23.412393+0000","last_undegraded":"2024-04-26T22:21:23.412393+0000","last_fullsized":"2024-04-26T22:21:23.412393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.414226+0000","last_change":"2024-04-26T22:21:21.402324+0000","last_active":"2024-04-26T22:21:23.414226+0000","last_peered":"2024-04-26T22:21:23.414226+0000","last_clean":"2024-04-26T22:21:23.414226+0000","last_became_active":"2024-04-26T22:21:21.402029+0000","last_became_peered":"2024-04-26T22:21:21.402029+0000","last_unstale":"2024-04-26T22:21:23.414226+0000","last_undegraded":"2024-04-26T22:21:23.414226+0000","last_fullsized":"2024-04-26T22:21:23.414226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268747+0000","last_change":"2024-04-26T22:21:22.429036+0000","last_active":"2024-04-26T22:21:24.268747+0000","last_peered":"2024-04-26T22:21:24.268747+0000","last_clean":"2024-04-26T22:21:24.268747+0000","last_became_active":"2024-04-26T22:21:22.417035+0000","last_became_peered":"2024-04-26T22:21:22.417035+0000","last_unstale":"2024-04-26T22:21:24.268747+0000","last_undegraded":"2024-04-26T22:21:24.268747+0000","last_fullsized":"2024-04-26T22:21:24.268747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408971+0000","last_change":"2024-04-26T22:21:21.396691+0000","last_active":"2024-04-26T22:21:23.408971+0000","last_peered":"2024-04-26T22:21:23.408971+0000","last_clean":"2024-04-26T22:21:23.408971+0000","last_became_active":"2024-04-26T22:21:21.395935+0000","last_became_peered":"2024-04-26T22:21:21.395935+0000","last_unstale":"2024-04-26T22:21:23.408971+0000","last_undegraded":"2024-04-26T22:21:23.408971+0000","last_fullsized":"2024-04-26T22:21:23.408971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297834+0000","last_change":"2024-04-26T22:21:22.418914+0000","last_active":"2024-04-26T22:21:24.297834+0000","last_peered":"2024-04-26T22:21:24.297834+0000","last_clean":"2024-04-26T22:21:24.297834+0000","last_became_active":"2024-04-26T22:21:22.418549+0000","last_became_peered":"2024-04-26T22:21:22.418549+0000","last_unstale":"2024-04-26T22:21:24.297834+0000","last_undegraded":"2024-04-26T22:21:24.297834+0000","last_fullsized":"2024-04-26T22:21:24.297834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:25:00.232825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296208+0000","last_change":"2024-04-26T22:21:21.406456+0000","last_active":"2024-04-26T22:21:24.296208+0000","last_peered":"2024-04-26T22:21:24.296208+0000","last_clean":"2024-04-26T22:21:24.296208+0000","last_became_active":"2024-04-26T22:21:21.406032+0000","last_became_peered":"2024-04-26T22:21:21.406032+0000","last_unstale":"2024-04-26T22:21:24.296208+0000","last_undegraded":"2024-04-26T22:21:24.296208+0000","last_fullsized":"2024-04-26T22:21:24.296208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408998+0000","last_change":"2024-04-26T22:21:22.394656+0000","last_active":"2024-04-26T22:21:23.408998+0000","last_peered":"2024-04-26T22:21:23.408998+0000","last_clean":"2024-04-26T22:21:23.408998+0000","last_became_active":"2024-04-26T22:21:22.394308+0000","last_became_peered":"2024-04-26T22:21:22.394308+0000","last_unstale":"2024-04-26T22:21:23.408998+0000","last_undegraded":"2024-04-26T22:21:23.408998+0000","last_fullsized":"2024-04-26T22:21:23.408998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412559+0000","last_change":"2024-04-26T22:21:21.410610+0000","last_active":"2024-04-26T22:21:23.412559+0000","last_peered":"2024-04-26T22:21:23.412559+0000","last_clean":"2024-04-26T22:21:23.412559+0000","last_became_active":"2024-04-26T22:21:21.410307+0000","last_became_peered":"2024-04-26T22:21:21.410307+0000","last_unstale":"2024-04-26T22:21:23.412559+0000","last_undegraded":"2024-04-26T22:21:23.412559+0000","last_fullsized":"2024-04-26T22:21:23.412559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268253+0000","last_change":"2024-04-26T22:21:22.403920+0000","last_active":"2024-04-26T22:21:24.268253+0000","last_peered":"2024-04-26T22:21:24.268253+0000","last_clean":"2024-04-26T22:21:24.268253+0000","last_became_active":"2024-04-26T22:21:22.403666+0000","last_became_peered":"2024-04-26T22:21:22.403666+0000","last_unstale":"2024-04-26T22:21:24.268253+0000","last_undegraded":"2024-04-26T22:21:24.268253+0000","last_fullsized":"2024-04-26T22:21:24.268253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412507+0000","last_change":"2024-04-26T22:21:21.402151+0000","last_active":"2024-04-26T22:21:23.412507+0000","last_peered":"2024-04-26T22:21:23.412507+0000","last_clean":"2024-04-26T22:21:23.412507+0000","last_became_active":"2024-04-26T22:21:21.401806+0000","last_became_peered":"2024-04-26T22:21:21.401806+0000","last_unstale":"2024-04-26T22:21:23.412507+0000","last_undegraded":"2024-04-26T22:21:23.412507+0000","last_fullsized":"2024-04-26T22:21:23.412507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268394+0000","last_change":"2024-04-26T22:21:22.429169+0000","last_active":"2024-04-26T22:21:24.268394+0000","last_peered":"2024-04-26T22:21:24.268394+0000","last_clean":"2024-04-26T22:21:24.268394+0000","last_became_active":"2024-04-26T22:21:22.428796+0000","last_became_peered":"2024-04-26T22:21:22.428796+0000","last_unstale":"2024-04-26T22:21:24.268394+0000","last_undegraded":"2024-04-26T22:21:24.268394+0000","last_fullsized":"2024-04-26T22:21:24.268394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296667+0000","last_change":"2024-04-26T22:21:21.408709+0000","last_active":"2024-04-26T22:21:24.296667+0000","last_peered":"2024-04-26T22:21:24.296667+0000","last_clean":"2024-04-26T22:21:24.296667+0000","last_became_active":"2024-04-26T22:21:21.408242+0000","last_became_peered":"2024-04-26T22:21:21.408242+0000","last_unstale":"2024-04-26T22:21:24.296667+0000","last_undegraded":"2024-04-26T22:21:24.296667+0000","last_fullsized":"2024-04-26T22:21:24.296667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:38.502586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408033+0000","last_change":"2024-04-26T22:21:22.406897+0000","last_active":"2024-04-26T22:21:23.408033+0000","last_peered":"2024-04-26T22:21:23.408033+0000","last_clean":"2024-04-26T22:21:23.408033+0000","last_became_active":"2024-04-26T22:21:22.406614+0000","last_became_peered":"2024-04-26T22:21:22.406614+0000","last_unstale":"2024-04-26T22:21:23.408033+0000","last_undegraded":"2024-04-26T22:21:23.408033+0000","last_fullsized":"2024-04-26T22:21:23.408033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203882+0000","last_change":"2024-04-26T22:21:22.404257+0000","last_active":"2024-04-26T22:21:24.203882+0000","last_peered":"2024-04-26T22:21:24.203882+0000","last_clean":"2024-04-26T22:21:24.203882+0000","last_became_active":"2024-04-26T22:21:22.403954+0000","last_became_peered":"2024-04-26T22:21:22.403954+0000","last_unstale":"2024-04-26T22:21:24.203882+0000","last_undegraded":"2024-04-26T22:21:24.203882+0000","last_fullsized":"2024-04-26T22:21:24.203882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:08.480631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296590+0000","last_change":"2024-04-26T22:21:21.406486+0000","last_active":"2024-04-26T22:21:24.296590+0000","last_peered":"2024-04-26T22:21:24.296590+0000","last_clean":"2024-04-26T22:21:24.296590+0000","last_became_active":"2024-04-26T22:21:21.406190+0000","last_became_peered":"2024-04-26T22:21:21.406190+0000","last_unstale":"2024-04-26T22:21:24.296590+0000","last_undegraded":"2024-04-26T22:21:24.296590+0000","last_fullsized":"2024-04-26T22:21:24.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:45.631147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203739+0000","last_change":"2024-04-26T22:21:22.415974+0000","last_active":"2024-04-26T22:21:24.203739+0000","last_peered":"2024-04-26T22:21:24.203739+0000","last_clean":"2024-04-26T22:21:24.203739+0000","last_became_active":"2024-04-26T22:21:22.415384+0000","last_became_peered":"2024-04-26T22:21:22.415384+0000","last_unstale":"2024-04-26T22:21:24.203739+0000","last_undegraded":"2024-04-26T22:21:24.203739+0000","last_fullsized":"2024-04-26T22:21:24.203739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296856+0000","last_change":"2024-04-26T22:21:21.405267+0000","last_active":"2024-04-26T22:21:24.296856+0000","last_peered":"2024-04-26T22:21:24.296856+0000","last_clean":"2024-04-26T22:21:24.296856+0000","last_became_active":"2024-04-26T22:21:21.404669+0000","last_became_peered":"2024-04-26T22:21:21.404669+0000","last_unstale":"2024-04-26T22:21:24.296856+0000","last_undegraded":"2024-04-26T22:21:24.296856+0000","last_fullsized":"2024-04-26T22:21:24.296856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297917+0000","last_change":"2024-04-26T22:21:22.422015+0000","last_active":"2024-04-26T22:21:24.297917+0000","last_peered":"2024-04-26T22:21:24.297917+0000","last_clean":"2024-04-26T22:21:24.297917+0000","last_became_active":"2024-04-26T22:21:22.421713+0000","last_became_peered":"2024-04-26T22:21:22.421713+0000","last_unstale":"2024-04-26T22:21:24.297917+0000","last_undegraded":"2024-04-26T22:21:24.297917+0000","last_fullsized":"2024-04-26T22:21:24.297917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:24:49.399695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268621+0000","last_change":"2024-04-26T22:21:21.396531+0000","last_active":"2024-04-26T22:21:24.268621+0000","last_peered":"2024-04-26T22:21:24.268621+0000","last_clean":"2024-04-26T22:21:24.268621+0000","last_became_active":"2024-04-26T22:21:21.395948+0000","last_became_peered":"2024-04-26T22:21:21.395948+0000","last_unstale":"2024-04-26T22:21:24.268621+0000","last_undegraded":"2024-04-26T22:21:24.268621+0000","last_fullsized":"2024-04-26T22:21:24.268621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268634+0000","last_change":"2024-04-26T22:21:22.406649+0000","last_active":"2024-04-26T22:21:24.268634+0000","last_peered":"2024-04-26T22:21:24.268634+0000","last_clean":"2024-04-26T22:21:24.268634+0000","last_became_active":"2024-04-26T22:21:22.406377+0000","last_became_peered":"2024-04-26T22:21:22.406377+0000","last_unstale":"2024-04-26T22:21:24.268634+0000","last_undegraded":"2024-04-26T22:21:24.268634+0000","last_fullsized":"2024-04-26T22:21:24.268634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297985+0000","last_change":"2024-04-26T22:21:21.401403+0000","last_active":"2024-04-26T22:21:24.297985+0000","last_peered":"2024-04-26T22:21:24.297985+0000","last_clean":"2024-04-26T22:21:24.297985+0000","last_became_active":"2024-04-26T22:21:21.401028+0000","last_became_peered":"2024-04-26T22:21:21.401028+0000","last_unstale":"2024-04-26T22:21:24.297985+0000","last_undegraded":"2024-04-26T22:21:24.297985+0000","last_fullsized":"2024-04-26T22:21:24.297985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:19.445168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:21:31.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:21:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.400+0000 7fe7b3a00640 1 Processor -- start 2024-04-26T22:21:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.400+0000 7fe7b3a00640 1 -- start start 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b3a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7ac13ef30 0x7fe7ac13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b3a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac06e830 con 0x7fe7ac06e450 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b3a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac0b0a30 con 0x7fe7ac14dac0 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b3a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0b0d10 con 0x7fe7ac13ef30 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b1000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe7ac06e450 0x7fe7ac0b1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59526/0 (socket says 172.21.15.16:59526) 2024-04-26T22:21:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b1000640 1 -- 172.21.15.16:0/1771879725 learned_addr learned my addr 172.21.15.16:0/1771879725 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/1771879725 >> v2:172.21.15.195:3300/0 conn(0x7fe7ac13ef30 0x7fe7ac13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524911621 0 0) 0x7fe7ac06e830 con 0x7fe7ac06e450 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe790003530 con 0x7fe7ac06e450 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4149860735 0 0) 0x7fe790003530 con 0x7fe7ac06e450 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 >> v2:172.21.15.195:3300/0 conn(0x7fe7ac13ef30 msgr2=0x7fe7ac13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 --2- 172.21.15.16:0/1771879725 >> v2:172.21.15.195:3300/0 conn(0x7fe7ac13ef30 0x7fe7ac13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 >> v1:172.21.15.195:6789/0 conn(0x7fe7ac14dac0 legacy=0x7fe7ac14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0b2cf0 con 0x7fe7ac06e450 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fe79c001680 con 0x7fe7ac06e450 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 >> v1:172.21.15.16:6789/0 conn(0x7fe7ac06e450 legacy=0x7fe7ac0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7900039c0 0x7fe790003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 0x7fe790004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7900052f0 0x7fe79000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b0d10 con 0x7fe790004810 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe79000c1c0 con 0x7fe7900039c0 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe79000c3c0 con 0x7fe7900052f0 2024-04-26T22:21:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 0x7fe790004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b1000640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7900039c0 0x7fe790003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b1a00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7900052f0 0x7fe79000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 -- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7900052f0 msgr2=0x7fe79000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7900052f0 0x7fe79000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 -- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7900039c0 msgr2=0x7fe790003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7900039c0 0x7fe790003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7a3e00640 1 -- 172.21.15.16:0/1771879725 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe790003530 con 0x7fe790004810 2024-04-26T22:21:31.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.404+0000 7fe7b1a00640 1 -- 172.21.15.16:0/1771879725 reap_dead start 2024-04-26T22:21:31.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 0x7fe790004c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe794009ab0 tx=0x7fe79401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f8e2a4e9ec9eff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940096b0 con 0x7fe790004810 2024-04-26T22:21:31.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7940a8450 con 0x7fe790004810 2024-04-26T22:21:31.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7abe00640 1 -- 172.21.15.16:0/1771879725 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7940a8840 con 0x7fe790004810 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 -- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 msgr2=0x7fe790004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 0x7fe790004c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe794009ab0 tx=0x7fe79401ca30 comp rx=0 tx=0).stop 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 -- 172.21.15.16:0/1771879725 shutdown_connections 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/1771879725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe790004810 0x7fe790004c90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 -- 172.21.15.16:0/1771879725 >> 172.21.15.16:0/1771879725 conn(0x7fe7ac0b6620 msgr2=0x7fe7ac0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 -- 172.21.15.16:0/1771879725 shutdown_connections 2024-04-26T22:21:31.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 -- 172.21.15.16:0/1771879725 wait complete. 2024-04-26T22:21:31.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.408+0000 7fe7b3a00640 1 Processor -- start 2024-04-26T22:21:31.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- start start 2024-04-26T22:21:31.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe790004810 0x7fe7ac152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7ac143e80 0x7fe7ac1e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b29b0 con 0x7fe7ac1442e0 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b2830 con 0x7fe790004810 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b34f0 con 0x7fe7ac143e80 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41898/0 (socket says 172.21.15.16:41898) 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 -- 172.21.15.16:0/403326050 learned_addr learned my addr 172.21.15.16:0/403326050 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1000640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe790004810 0x7fe7ac152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7a3e00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7ac143e80 0x7fe7ac1e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 -- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7ac143e80 msgr2=0x7fe7ac1e4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7ac143e80 0x7fe7ac1e4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 -- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe790004810 msgr2=0x7fe7ac152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe790004810 0x7fe7ac152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 -- 172.21.15.16:0/403326050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac154ac0 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b1a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac070450 tx=0x7fe7a400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4003980 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a4018070 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4003d80 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac145d10 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac143930 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.412+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac069530 con 0x7fe7ac1442e0 2024-04-26T22:21:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.416+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7a40050d0 con 0x7fe7ac1442e0 2024-04-26T22:21:31.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.416+0000 7fe7a9600640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 0x7fe78806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.416+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe7a4086420 con 0x7fe7ac1442e0 2024-04-26T22:21:31.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.416+0000 7fe7b1000640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 0x7fe78806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.416+0000 7fe7b1000640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 0x7fe78806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007d40 tx=0x7fe79c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.420+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7a4056420 con 0x7fe7ac1442e0 2024-04-26T22:21:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.580+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7ac14d080 con 0x7fe788068380 2024-04-26T22:21:31.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.588+0000 7fe7a9600640 1 -- 172.21.15.16:0/403326050 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fe7ac14d080 con 0x7fe788068380 2024-04-26T22:21:31.591 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:31.592 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:21:31.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 msgr2=0x7fe78806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 0x7fe78806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe79c007d40 tx=0x7fe79c007900 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 msgr2=0x7fe7ac1e4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac070450 tx=0x7fe7a400eb90 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 shutdown_connections 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe788068380 0x7fe78806a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7ac1442e0 0x7fe7ac1e4cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7ac143e80 0x7fe7ac1e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 --2- 172.21.15.16:0/403326050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe790004810 0x7fe7ac152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 >> 172.21.15.16:0/403326050 conn(0x7fe7ac0b6620 msgr2=0x7fe7ac06d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 shutdown_connections 2024-04-26T22:21:31.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.592+0000 7fe7b3a00640 1 -- 172.21.15.16:0/403326050 wait complete. 2024-04-26T22:21:31.612 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T22:21:30.102925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248252,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754726468,"statfs":{"total":773094113280,"available":772839903232,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002150"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296939+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:24.296939+0000","last_peered":"2024-04-26T22:21:24.296939+0000","last_clean":"2024-04-26T22:21:24.296939+0000","last_became_active":"2024-04-26T22:21:22.404969+0000","last_became_peered":"2024-04-26T22:21:22.404969+0000","last_unstale":"2024-04-26T22:21:24.296939+0000","last_undegraded":"2024-04-26T22:21:24.296939+0000","last_fullsized":"2024-04-26T22:21:24.296939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:15.073482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412521+0000","last_change":"2024-04-26T22:21:22.419853+0000","last_active":"2024-04-26T22:21:23.412521+0000","last_peered":"2024-04-26T22:21:23.412521+0000","last_clean":"2024-04-26T22:21:23.412521+0000","last_became_active":"2024-04-26T22:21:22.419507+0000","last_became_peered":"2024-04-26T22:21:22.419507+0000","last_unstale":"2024-04-26T22:21:23.412521+0000","last_undegraded":"2024-04-26T22:21:23.412521+0000","last_fullsized":"2024-04-26T22:21:23.412521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297702+0000","last_change":"2024-04-26T22:21:22.402773+0000","last_active":"2024-04-26T22:21:24.297702+0000","last_peered":"2024-04-26T22:21:24.297702+0000","last_clean":"2024-04-26T22:21:24.297702+0000","last_became_active":"2024-04-26T22:21:22.402398+0000","last_became_peered":"2024-04-26T22:21:22.402398+0000","last_unstale":"2024-04-26T22:21:24.297702+0000","last_undegraded":"2024-04-26T22:21:24.297702+0000","last_fullsized":"2024-04-26T22:21:24.297702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.611708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203866+0000","last_change":"2024-04-26T22:21:22.419823+0000","last_active":"2024-04-26T22:21:24.203866+0000","last_peered":"2024-04-26T22:21:24.203866+0000","last_clean":"2024-04-26T22:21:24.203866+0000","last_became_active":"2024-04-26T22:21:22.419566+0000","last_became_peered":"2024-04-26T22:21:22.419566+0000","last_unstale":"2024-04-26T22:21:24.203866+0000","last_undegraded":"2024-04-26T22:21:24.203866+0000","last_fullsized":"2024-04-26T22:21:24.203866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:43.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296555+0000","last_change":"2024-04-26T22:21:22.406403+0000","last_active":"2024-04-26T22:21:24.296555+0000","last_peered":"2024-04-26T22:21:24.296555+0000","last_clean":"2024-04-26T22:21:24.296555+0000","last_became_active":"2024-04-26T22:21:22.406043+0000","last_became_peered":"2024-04-26T22:21:22.406043+0000","last_unstale":"2024-04-26T22:21:24.296555+0000","last_undegraded":"2024-04-26T22:21:24.296555+0000","last_fullsized":"2024-04-26T22:21:24.296555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:43.509349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203595+0000","last_change":"2024-04-26T22:21:22.414425+0000","last_active":"2024-04-26T22:21:24.203595+0000","last_peered":"2024-04-26T22:21:24.203595+0000","last_clean":"2024-04-26T22:21:24.203595+0000","last_became_active":"2024-04-26T22:21:22.414091+0000","last_became_peered":"2024-04-26T22:21:22.414091+0000","last_unstale":"2024-04-26T22:21:24.203595+0000","last_undegraded":"2024-04-26T22:21:24.203595+0000","last_fullsized":"2024-04-26T22:21:24.203595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296402+0000","last_change":"2024-04-26T22:21:22.416374+0000","last_active":"2024-04-26T22:21:24.296402+0000","last_peered":"2024-04-26T22:21:24.296402+0000","last_clean":"2024-04-26T22:21:24.296402+0000","last_became_active":"2024-04-26T22:21:22.415971+0000","last_became_peered":"2024-04-26T22:21:22.415971+0000","last_unstale":"2024-04-26T22:21:24.296402+0000","last_undegraded":"2024-04-26T22:21:24.296402+0000","last_fullsized":"2024-04-26T22:21:24.296402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268052+0000","last_change":"2024-04-26T22:21:22.426064+0000","last_active":"2024-04-26T22:21:24.268052+0000","last_peered":"2024-04-26T22:21:24.268052+0000","last_clean":"2024-04-26T22:21:24.268052+0000","last_became_active":"2024-04-26T22:21:22.425772+0000","last_became_peered":"2024-04-26T22:21:22.425772+0000","last_unstale":"2024-04-26T22:21:24.268052+0000","last_undegraded":"2024-04-26T22:21:24.268052+0000","last_fullsized":"2024-04-26T22:21:24.268052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297065+0000","last_change":"2024-04-26T22:21:22.419613+0000","last_active":"2024-04-26T22:21:24.297065+0000","last_peered":"2024-04-26T22:21:24.297065+0000","last_clean":"2024-04-26T22:21:24.297065+0000","last_became_active":"2024-04-26T22:21:22.419007+0000","last_became_peered":"2024-04-26T22:21:22.419007+0000","last_unstale":"2024-04-26T22:21:24.297065+0000","last_undegraded":"2024-04-26T22:21:24.297065+0000","last_fullsized":"2024-04-26T22:21:24.297065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:16.311995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409029+0000","last_change":"2024-04-26T22:21:22.423811+0000","last_active":"2024-04-26T22:21:23.409029+0000","last_peered":"2024-04-26T22:21:23.409029+0000","last_clean":"2024-04-26T22:21:23.409029+0000","last_became_active":"2024-04-26T22:21:22.418209+0000","last_became_peered":"2024-04-26T22:21:22.418209+0000","last_unstale":"2024-04-26T22:21:23.409029+0000","last_undegraded":"2024-04-26T22:21:23.409029+0000","last_fullsized":"2024-04-26T22:21:23.409029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408471+0000","last_change":"2024-04-26T22:21:22.417717+0000","last_active":"2024-04-26T22:21:23.408471+0000","last_peered":"2024-04-26T22:21:23.408471+0000","last_clean":"2024-04-26T22:21:23.408471+0000","last_became_active":"2024-04-26T22:21:22.417411+0000","last_became_peered":"2024-04-26T22:21:22.417411+0000","last_unstale":"2024-04-26T22:21:23.408471+0000","last_undegraded":"2024-04-26T22:21:23.408471+0000","last_fullsized":"2024-04-26T22:21:23.408471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409203+0000","last_change":"2024-04-26T22:21:22.399958+0000","last_active":"2024-04-26T22:21:23.409203+0000","last_peered":"2024-04-26T22:21:23.409203+0000","last_clean":"2024-04-26T22:21:23.409203+0000","last_became_active":"2024-04-26T22:21:22.398263+0000","last_became_peered":"2024-04-26T22:21:22.398263+0000","last_unstale":"2024-04-26T22:21:23.409203+0000","last_undegraded":"2024-04-26T22:21:23.409203+0000","last_fullsized":"2024-04-26T22:21:23.409203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:10.639008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268272+0000","last_change":"2024-04-26T22:21:22.401315+0000","last_active":"2024-04-26T22:21:24.268272+0000","last_peered":"2024-04-26T22:21:24.268272+0000","last_clean":"2024-04-26T22:21:24.268272+0000","last_became_active":"2024-04-26T22:21:22.401055+0000","last_became_peered":"2024-04-26T22:21:22.401055+0000","last_unstale":"2024-04-26T22:21:24.268272+0000","last_undegraded":"2024-04-26T22:21:24.268272+0000","last_fullsized":"2024-04-26T22:21:24.268272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297345+0000","last_change":"2024-04-26T22:21:22.401017+0000","last_active":"2024-04-26T22:21:24.297345+0000","last_peered":"2024-04-26T22:21:24.297345+0000","last_clean":"2024-04-26T22:21:24.297345+0000","last_became_active":"2024-04-26T22:21:22.400740+0000","last_became_peered":"2024-04-26T22:21:22.400740+0000","last_unstale":"2024-04-26T22:21:24.297345+0000","last_undegraded":"2024-04-26T22:21:24.297345+0000","last_fullsized":"2024-04-26T22:21:24.297345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:02.215791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412340+0000","last_change":"2024-04-26T22:21:22.391216+0000","last_active":"2024-04-26T22:21:23.412340+0000","last_peered":"2024-04-26T22:21:23.412340+0000","last_clean":"2024-04-26T22:21:23.412340+0000","last_became_active":"2024-04-26T22:21:22.390914+0000","last_became_peered":"2024-04-26T22:21:22.390914+0000","last_unstale":"2024-04-26T22:21:23.412340+0000","last_undegraded":"2024-04-26T22:21:23.412340+0000","last_fullsized":"2024-04-26T22:21:23.412340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203419+0000","last_change":"2024-04-26T22:21:22.415179+0000","last_active":"2024-04-26T22:21:24.203419+0000","last_peered":"2024-04-26T22:21:24.203419+0000","last_clean":"2024-04-26T22:21:24.203419+0000","last_became_active":"2024-04-26T22:21:22.414894+0000","last_became_peered":"2024-04-26T22:21:22.414894+0000","last_unstale":"2024-04-26T22:21:24.203419+0000","last_undegraded":"2024-04-26T22:21:24.203419+0000","last_fullsized":"2024-04-26T22:21:24.203419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204210+0000","last_change":"2024-04-26T22:21:22.414418+0000","last_active":"2024-04-26T22:21:24.204210+0000","last_peered":"2024-04-26T22:21:24.204210+0000","last_clean":"2024-04-26T22:21:24.204210+0000","last_became_active":"2024-04-26T22:21:22.413203+0000","last_became_peered":"2024-04-26T22:21:22.413203+0000","last_unstale":"2024-04-26T22:21:24.204210+0000","last_undegraded":"2024-04-26T22:21:24.204210+0000","last_fullsized":"2024-04-26T22:21:24.204210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:37.693100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408121+0000","last_change":"2024-04-26T22:21:22.406821+0000","last_active":"2024-04-26T22:21:23.408121+0000","last_peered":"2024-04-26T22:21:23.408121+0000","last_clean":"2024-04-26T22:21:23.408121+0000","last_became_active":"2024-04-26T22:21:22.406613+0000","last_became_peered":"2024-04-26T22:21:22.406613+0000","last_unstale":"2024-04-26T22:21:23.408121+0000","last_undegraded":"2024-04-26T22:21:23.408121+0000","last_fullsized":"2024-04-26T22:21:23.408121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296977+0000","last_change":"2024-04-26T22:21:22.410515+0000","last_active":"2024-04-26T22:21:24.296977+0000","last_peered":"2024-04-26T22:21:24.296977+0000","last_clean":"2024-04-26T22:21:24.296977+0000","last_became_active":"2024-04-26T22:21:22.410219+0000","last_became_peered":"2024-04-26T22:21:22.410219+0000","last_unstale":"2024-04-26T22:21:24.296977+0000","last_undegraded":"2024-04-26T22:21:24.296977+0000","last_fullsized":"2024-04-26T22:21:24.296977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:25.382692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409256+0000","last_change":"2024-04-26T22:21:22.407928+0000","last_active":"2024-04-26T22:21:23.409256+0000","last_peered":"2024-04-26T22:21:23.409256+0000","last_clean":"2024-04-26T22:21:23.409256+0000","last_became_active":"2024-04-26T22:21:22.407586+0000","last_became_peered":"2024-04-26T22:21:22.407586+0000","last_unstale":"2024-04-26T22:21:23.409256+0000","last_undegraded":"2024-04-26T22:21:23.409256+0000","last_fullsized":"2024-04-26T22:21:23.409256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297513+0000","last_change":"2024-04-26T22:21:22.415479+0000","last_active":"2024-04-26T22:21:24.297513+0000","last_peered":"2024-04-26T22:21:24.297513+0000","last_clean":"2024-04-26T22:21:24.297513+0000","last_became_active":"2024-04-26T22:21:22.415221+0000","last_became_peered":"2024-04-26T22:21:22.415221+0000","last_unstale":"2024-04-26T22:21:24.297513+0000","last_undegraded":"2024-04-26T22:21:24.297513+0000","last_fullsized":"2024-04-26T22:21:24.297513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:39:06.935658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203562+0000","last_change":"2024-04-26T22:21:22.412956+0000","last_active":"2024-04-26T22:21:24.203562+0000","last_peered":"2024-04-26T22:21:24.203562+0000","last_clean":"2024-04-26T22:21:24.203562+0000","last_became_active":"2024-04-26T22:21:22.412717+0000","last_became_peered":"2024-04-26T22:21:22.412717+0000","last_unstale":"2024-04-26T22:21:24.203562+0000","last_undegraded":"2024-04-26T22:21:24.203562+0000","last_fullsized":"2024-04-26T22:21:24.203562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268197+0000","last_change":"2024-04-26T22:21:22.410307+0000","last_active":"2024-04-26T22:21:24.268197+0000","last_peered":"2024-04-26T22:21:24.268197+0000","last_clean":"2024-04-26T22:21:24.268197+0000","last_became_active":"2024-04-26T22:21:22.410111+0000","last_became_peered":"2024-04-26T22:21:22.410111+0000","last_unstale":"2024-04-26T22:21:24.268197+0000","last_undegraded":"2024-04-26T22:21:24.268197+0000","last_fullsized":"2024-04-26T22:21:24.268197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203611+0000","last_change":"2024-04-26T22:21:22.427712+0000","last_active":"2024-04-26T22:21:24.203611+0000","last_peered":"2024-04-26T22:21:24.203611+0000","last_clean":"2024-04-26T22:21:24.203611+0000","last_became_active":"2024-04-26T22:21:22.427358+0000","last_became_peered":"2024-04-26T22:21:22.427358+0000","last_unstale":"2024-04-26T22:21:24.203611+0000","last_undegraded":"2024-04-26T22:21:24.203611+0000","last_fullsized":"2024-04-26T22:21:24.203611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268627+0000","last_change":"2024-04-26T22:21:22.412148+0000","last_active":"2024-04-26T22:21:24.268627+0000","last_peered":"2024-04-26T22:21:24.268627+0000","last_clean":"2024-04-26T22:21:24.268627+0000","last_became_active":"2024-04-26T22:21:22.411380+0000","last_became_peered":"2024-04-26T22:21:22.411380+0000","last_unstale":"2024-04-26T22:21:24.268627+0000","last_undegraded":"2024-04-26T22:21:24.268627+0000","last_fullsized":"2024-04-26T22:21:24.268627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:46.510031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409175+0000","last_change":"2024-04-26T22:21:22.412872+0000","last_active":"2024-04-26T22:21:23.409175+0000","last_peered":"2024-04-26T22:21:23.409175+0000","last_clean":"2024-04-26T22:21:23.409175+0000","last_became_active":"2024-04-26T22:21:22.412429+0000","last_became_peered":"2024-04-26T22:21:22.412429+0000","last_unstale":"2024-04-26T22:21:23.409175+0000","last_undegraded":"2024-04-26T22:21:23.409175+0000","last_fullsized":"2024-04-26T22:21:23.409175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412454+0000","last_change":"2024-04-26T22:21:22.403344+0000","last_active":"2024-04-26T22:21:23.412454+0000","last_peered":"2024-04-26T22:21:23.412454+0000","last_clean":"2024-04-26T22:21:23.412454+0000","last_became_active":"2024-04-26T22:21:22.403042+0000","last_became_peered":"2024-04-26T22:21:22.403042+0000","last_unstale":"2024-04-26T22:21:23.412454+0000","last_undegraded":"2024-04-26T22:21:23.412454+0000","last_fullsized":"2024-04-26T22:21:23.412454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268583+0000","last_change":"2024-04-26T22:21:22.411698+0000","last_active":"2024-04-26T22:21:24.268583+0000","last_peered":"2024-04-26T22:21:24.268583+0000","last_clean":"2024-04-26T22:21:24.268583+0000","last_became_active":"2024-04-26T22:21:22.410959+0000","last_became_peered":"2024-04-26T22:21:22.410959+0000","last_unstale":"2024-04-26T22:21:24.268583+0000","last_undegraded":"2024-04-26T22:21:24.268583+0000","last_fullsized":"2024-04-26T22:21:24.268583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:25.147835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297636+0000","last_change":"2024-04-26T22:21:22.414909+0000","last_active":"2024-04-26T22:21:24.297636+0000","last_peered":"2024-04-26T22:21:24.297636+0000","last_clean":"2024-04-26T22:21:24.297636+0000","last_became_active":"2024-04-26T22:21:22.412967+0000","last_became_peered":"2024-04-26T22:21:22.412967+0000","last_unstale":"2024-04-26T22:21:24.297636+0000","last_undegraded":"2024-04-26T22:21:24.297636+0000","last_fullsized":"2024-04-26T22:21:24.297636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:04.915714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203788+0000","last_change":"2024-04-26T22:21:22.412771+0000","last_active":"2024-04-26T22:21:24.203788+0000","last_peered":"2024-04-26T22:21:24.203788+0000","last_clean":"2024-04-26T22:21:24.203788+0000","last_became_active":"2024-04-26T22:21:22.412269+0000","last_became_peered":"2024-04-26T22:21:22.412269+0000","last_unstale":"2024-04-26T22:21:24.203788+0000","last_undegraded":"2024-04-26T22:21:24.203788+0000","last_fullsized":"2024-04-26T22:21:24.203788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408052+0000","last_change":"2024-04-26T22:21:22.420475+0000","last_active":"2024-04-26T22:21:23.408052+0000","last_peered":"2024-04-26T22:21:23.408052+0000","last_clean":"2024-04-26T22:21:23.408052+0000","last_became_active":"2024-04-26T22:21:22.420224+0000","last_became_peered":"2024-04-26T22:21:22.420224+0000","last_unstale":"2024-04-26T22:21:23.408052+0000","last_undegraded":"2024-04-26T22:21:23.408052+0000","last_fullsized":"2024-04-26T22:21:23.408052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408065+0000","last_change":"2024-04-26T22:21:22.417961+0000","last_active":"2024-04-26T22:21:23.408065+0000","last_peered":"2024-04-26T22:21:23.408065+0000","last_clean":"2024-04-26T22:21:23.408065+0000","last_became_active":"2024-04-26T22:21:22.417173+0000","last_became_peered":"2024-04-26T22:21:22.417173+0000","last_unstale":"2024-04-26T22:21:23.408065+0000","last_undegraded":"2024-04-26T22:21:23.408065+0000","last_fullsized":"2024-04-26T22:21:23.408065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:04.516601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409653+0000","last_change":"2024-04-26T22:21:22.399070+0000","last_active":"2024-04-26T22:21:23.409653+0000","last_peered":"2024-04-26T22:21:23.409653+0000","last_clean":"2024-04-26T22:21:23.409653+0000","last_became_active":"2024-04-26T22:21:22.398182+0000","last_became_peered":"2024-04-26T22:21:22.398182+0000","last_unstale":"2024-04-26T22:21:23.409653+0000","last_undegraded":"2024-04-26T22:21:23.409653+0000","last_fullsized":"2024-04-26T22:21:23.409653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:57.144452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268411+0000","last_change":"2024-04-26T22:21:21.400248+0000","last_active":"2024-04-26T22:21:24.268411+0000","last_peered":"2024-04-26T22:21:24.268411+0000","last_clean":"2024-04-26T22:21:24.268411+0000","last_became_active":"2024-04-26T22:21:21.399953+0000","last_became_peered":"2024-04-26T22:21:21.399953+0000","last_unstale":"2024-04-26T22:21:24.268411+0000","last_undegraded":"2024-04-26T22:21:24.268411+0000","last_fullsized":"2024-04-26T22:21:24.268411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297720+0000","last_change":"2024-04-26T22:21:22.414633+0000","last_active":"2024-04-26T22:21:24.297720+0000","last_peered":"2024-04-26T22:21:24.297720+0000","last_clean":"2024-04-26T22:21:24.297720+0000","last_became_active":"2024-04-26T22:21:22.414387+0000","last_became_peered":"2024-04-26T22:21:22.414387+0000","last_unstale":"2024-04-26T22:21:24.297720+0000","last_undegraded":"2024-04-26T22:21:24.297720+0000","last_fullsized":"2024-04-26T22:21:24.297720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:20.041652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408260+0000","last_change":"2024-04-26T22:21:21.400875+0000","last_active":"2024-04-26T22:21:23.408260+0000","last_peered":"2024-04-26T22:21:23.408260+0000","last_clean":"2024-04-26T22:21:23.408260+0000","last_became_active":"2024-04-26T22:21:21.400561+0000","last_became_peered":"2024-04-26T22:21:21.400561+0000","last_unstale":"2024-04-26T22:21:23.408260+0000","last_undegraded":"2024-04-26T22:21:23.408260+0000","last_fullsized":"2024-04-26T22:21:23.408260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268273+0000","last_change":"2024-04-26T22:21:21.395724+0000","last_active":"2024-04-26T22:21:24.268273+0000","last_peered":"2024-04-26T22:21:24.268273+0000","last_clean":"2024-04-26T22:21:24.268273+0000","last_became_active":"2024-04-26T22:21:21.395270+0000","last_became_peered":"2024-04-26T22:21:21.395270+0000","last_unstale":"2024-04-26T22:21:24.268273+0000","last_undegraded":"2024-04-26T22:21:24.268273+0000","last_fullsized":"2024-04-26T22:21:24.268273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268116+0000","last_change":"2024-04-26T22:21:22.425600+0000","last_active":"2024-04-26T22:21:24.268116+0000","last_peered":"2024-04-26T22:21:24.268116+0000","last_clean":"2024-04-26T22:21:24.268116+0000","last_became_active":"2024-04-26T22:21:22.420621+0000","last_became_peered":"2024-04-26T22:21:22.420621+0000","last_unstale":"2024-04-26T22:21:24.268116+0000","last_undegraded":"2024-04-26T22:21:24.268116+0000","last_fullsized":"2024-04-26T22:21:24.268116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203584+0000","last_change":"2024-04-26T22:21:21.396563+0000","last_active":"2024-04-26T22:21:24.203584+0000","last_peered":"2024-04-26T22:21:24.203584+0000","last_clean":"2024-04-26T22:21:24.203584+0000","last_became_active":"2024-04-26T22:21:21.393730+0000","last_became_peered":"2024-04-26T22:21:21.393730+0000","last_unstale":"2024-04-26T22:21:24.203584+0000","last_undegraded":"2024-04-26T22:21:24.203584+0000","last_fullsized":"2024-04-26T22:21:24.203584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412421+0000","last_change":"2024-04-26T22:21:22.399913+0000","last_active":"2024-04-26T22:21:23.412421+0000","last_peered":"2024-04-26T22:21:23.412421+0000","last_clean":"2024-04-26T22:21:23.412421+0000","last_became_active":"2024-04-26T22:21:22.399633+0000","last_became_peered":"2024-04-26T22:21:22.399633+0000","last_unstale":"2024-04-26T22:21:23.412421+0000","last_undegraded":"2024-04-26T22:21:23.412421+0000","last_fullsized":"2024-04-26T22:21:23.412421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408864+0000","last_change":"2024-04-26T22:21:21.401808+0000","last_active":"2024-04-26T22:21:23.408864+0000","last_peered":"2024-04-26T22:21:23.408864+0000","last_clean":"2024-04-26T22:21:23.408864+0000","last_became_active":"2024-04-26T22:21:21.401323+0000","last_became_peered":"2024-04-26T22:21:21.401323+0000","last_unstale":"2024-04-26T22:21:23.408864+0000","last_undegraded":"2024-04-26T22:21:23.408864+0000","last_fullsized":"2024-04-26T22:21:23.408864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203974+0000","last_change":"2024-04-26T22:21:22.416004+0000","last_active":"2024-04-26T22:21:24.203974+0000","last_peered":"2024-04-26T22:21:24.203974+0000","last_clean":"2024-04-26T22:21:24.203974+0000","last_became_active":"2024-04-26T22:21:22.415730+0000","last_became_peered":"2024-04-26T22:21:22.415730+0000","last_unstale":"2024-04-26T22:21:24.203974+0000","last_undegraded":"2024-04-26T22:21:24.203974+0000","last_fullsized":"2024-04-26T22:21:24.203974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:05.885186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203957+0000","last_change":"2024-04-26T22:21:21.403091+0000","last_active":"2024-04-26T22:21:24.203957+0000","last_peered":"2024-04-26T22:21:24.203957+0000","last_clean":"2024-04-26T22:21:24.203957+0000","last_became_active":"2024-04-26T22:21:21.402767+0000","last_became_peered":"2024-04-26T22:21:21.402767+0000","last_unstale":"2024-04-26T22:21:24.203957+0000","last_undegraded":"2024-04-26T22:21:24.203957+0000","last_fullsized":"2024-04-26T22:21:24.203957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297940+0000","last_change":"2024-04-26T22:21:22.421952+0000","last_active":"2024-04-26T22:21:24.297940+0000","last_peered":"2024-04-26T22:21:24.297940+0000","last_clean":"2024-04-26T22:21:24.297940+0000","last_became_active":"2024-04-26T22:21:22.421689+0000","last_became_peered":"2024-04-26T22:21:22.421689+0000","last_unstale":"2024-04-26T22:21:24.297940+0000","last_undegraded":"2024-04-26T22:21:24.297940+0000","last_fullsized":"2024-04-26T22:21:24.297940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:08.627275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412426+0000","last_change":"2024-04-26T22:21:21.410257+0000","last_active":"2024-04-26T22:21:23.412426+0000","last_peered":"2024-04-26T22:21:23.412426+0000","last_clean":"2024-04-26T22:21:23.412426+0000","last_became_active":"2024-04-26T22:21:21.409894+0000","last_became_peered":"2024-04-26T22:21:21.409894+0000","last_unstale":"2024-04-26T22:21:23.412426+0000","last_undegraded":"2024-04-26T22:21:23.412426+0000","last_fullsized":"2024-04-26T22:21:23.412426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409320+0000","last_change":"2024-04-26T22:21:22.404687+0000","last_active":"2024-04-26T22:21:23.409320+0000","last_peered":"2024-04-26T22:21:23.409320+0000","last_clean":"2024-04-26T22:21:23.409320+0000","last_became_active":"2024-04-26T22:21:22.404406+0000","last_became_peered":"2024-04-26T22:21:22.404406+0000","last_unstale":"2024-04-26T22:21:23.409320+0000","last_undegraded":"2024-04-26T22:21:23.409320+0000","last_fullsized":"2024-04-26T22:21:23.409320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:22.370238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409406+0000","last_change":"2024-04-26T22:21:21.390689+0000","last_active":"2024-04-26T22:21:23.409406+0000","last_peered":"2024-04-26T22:21:23.409406+0000","last_clean":"2024-04-26T22:21:23.409406+0000","last_became_active":"2024-04-26T22:21:21.390404+0000","last_became_peered":"2024-04-26T22:21:21.390404+0000","last_unstale":"2024-04-26T22:21:23.409406+0000","last_undegraded":"2024-04-26T22:21:23.409406+0000","last_fullsized":"2024-04-26T22:21:23.409406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:07:21.364806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296716+0000","last_change":"2024-04-26T22:21:22.407190+0000","last_active":"2024-04-26T22:21:24.296716+0000","last_peered":"2024-04-26T22:21:24.296716+0000","last_clean":"2024-04-26T22:21:24.296716+0000","last_became_active":"2024-04-26T22:21:22.406951+0000","last_became_peered":"2024-04-26T22:21:22.406951+0000","last_unstale":"2024-04-26T22:21:24.296716+0000","last_undegraded":"2024-04-26T22:21:24.296716+0000","last_fullsized":"2024-04-26T22:21:24.296716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:05.885186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297788+0000","last_change":"2024-04-26T22:21:21.392411+0000","last_active":"2024-04-26T22:21:24.297788+0000","last_peered":"2024-04-26T22:21:24.297788+0000","last_clean":"2024-04-26T22:21:24.297788+0000","last_became_active":"2024-04-26T22:21:21.392091+0000","last_became_peered":"2024-04-26T22:21:21.392091+0000","last_unstale":"2024-04-26T22:21:24.297788+0000","last_undegraded":"2024-04-26T22:21:24.297788+0000","last_fullsized":"2024-04-26T22:21:24.297788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:39.738654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297490+0000","last_change":"2024-04-26T22:21:22.415923+0000","last_active":"2024-04-26T22:21:24.297490+0000","last_peered":"2024-04-26T22:21:24.297490+0000","last_clean":"2024-04-26T22:21:24.297490+0000","last_became_active":"2024-04-26T22:21:22.415523+0000","last_became_peered":"2024-04-26T22:21:22.415523+0000","last_unstale":"2024-04-26T22:21:24.297490+0000","last_undegraded":"2024-04-26T22:21:24.297490+0000","last_fullsized":"2024-04-26T22:21:24.297490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:23.620856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203791+0000","last_change":"2024-04-26T22:21:21.397039+0000","last_active":"2024-04-26T22:21:24.203791+0000","last_peered":"2024-04-26T22:21:24.203791+0000","last_clean":"2024-04-26T22:21:24.203791+0000","last_became_active":"2024-04-26T22:21:21.395448+0000","last_became_peered":"2024-04-26T22:21:21.395448+0000","last_unstale":"2024-04-26T22:21:24.203791+0000","last_undegraded":"2024-04-26T22:21:24.203791+0000","last_fullsized":"2024-04-26T22:21:24.203791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296625+0000","last_change":"2024-04-26T22:21:22.409452+0000","last_active":"2024-04-26T22:21:24.296625+0000","last_peered":"2024-04-26T22:21:24.296625+0000","last_clean":"2024-04-26T22:21:24.296625+0000","last_became_active":"2024-04-26T22:21:22.406210+0000","last_became_peered":"2024-04-26T22:21:22.406210+0000","last_unstale":"2024-04-26T22:21:24.296625+0000","last_undegraded":"2024-04-26T22:21:24.296625+0000","last_fullsized":"2024-04-26T22:21:24.296625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:08.480631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408048+0000","last_change":"2024-04-26T22:21:21.395875+0000","last_active":"2024-04-26T22:21:23.408048+0000","last_peered":"2024-04-26T22:21:23.408048+0000","last_clean":"2024-04-26T22:21:23.408048+0000","last_became_active":"2024-04-26T22:21:21.395537+0000","last_became_peered":"2024-04-26T22:21:21.395537+0000","last_unstale":"2024-04-26T22:21:23.408048+0000","last_undegraded":"2024-04-26T22:21:23.408048+0000","last_fullsized":"2024-04-26T22:21:23.408048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409338+0000","last_change":"2024-04-26T22:21:22.401767+0000","last_active":"2024-04-26T22:21:23.409338+0000","last_peered":"2024-04-26T22:21:23.409338+0000","last_clean":"2024-04-26T22:21:23.409338+0000","last_became_active":"2024-04-26T22:21:22.401447+0000","last_became_peered":"2024-04-26T22:21:22.401447+0000","last_unstale":"2024-04-26T22:21:23.409338+0000","last_undegraded":"2024-04-26T22:21:23.409338+0000","last_fullsized":"2024-04-26T22:21:23.409338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:33.506016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.407992+0000","last_change":"2024-04-26T22:21:21.403885+0000","last_active":"2024-04-26T22:21:23.407992+0000","last_peered":"2024-04-26T22:21:23.407992+0000","last_clean":"2024-04-26T22:21:23.407992+0000","last_became_active":"2024-04-26T22:21:21.403438+0000","last_became_peered":"2024-04-26T22:21:21.403438+0000","last_unstale":"2024-04-26T22:21:23.407992+0000","last_undegraded":"2024-04-26T22:21:23.407992+0000","last_fullsized":"2024-04-26T22:21:23.407992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:54.651205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296482+0000","last_change":"2024-04-26T22:21:22.411158+0000","last_active":"2024-04-26T22:21:24.296482+0000","last_peered":"2024-04-26T22:21:24.296482+0000","last_clean":"2024-04-26T22:21:24.296482+0000","last_became_active":"2024-04-26T22:21:22.410853+0000","last_became_peered":"2024-04-26T22:21:22.410853+0000","last_unstale":"2024-04-26T22:21:24.296482+0000","last_undegraded":"2024-04-26T22:21:24.296482+0000","last_fullsized":"2024-04-26T22:21:24.296482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408979+0000","last_change":"2024-04-26T22:21:21.392442+0000","last_active":"2024-04-26T22:21:23.408979+0000","last_peered":"2024-04-26T22:21:23.408979+0000","last_clean":"2024-04-26T22:21:23.408979+0000","last_became_active":"2024-04-26T22:21:21.389407+0000","last_became_peered":"2024-04-26T22:21:21.389407+0000","last_unstale":"2024-04-26T22:21:23.408979+0000","last_undegraded":"2024-04-26T22:21:23.408979+0000","last_fullsized":"2024-04-26T22:21:23.408979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.950669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296957+0000","last_change":"2024-04-26T22:21:22.406366+0000","last_active":"2024-04-26T22:21:24.296957+0000","last_peered":"2024-04-26T22:21:24.296957+0000","last_clean":"2024-04-26T22:21:24.296957+0000","last_became_active":"2024-04-26T22:21:22.406094+0000","last_became_peered":"2024-04-26T22:21:22.406094+0000","last_unstale":"2024-04-26T22:21:24.296957+0000","last_undegraded":"2024-04-26T22:21:24.296957+0000","last_fullsized":"2024-04-26T22:21:24.296957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:16:37.693100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408162+0000","last_change":"2024-04-26T22:21:21.396566+0000","last_active":"2024-04-26T22:21:23.408162+0000","last_peered":"2024-04-26T22:21:23.408162+0000","last_clean":"2024-04-26T22:21:23.408162+0000","last_became_active":"2024-04-26T22:21:21.396207+0000","last_became_peered":"2024-04-26T22:21:21.396207+0000","last_unstale":"2024-04-26T22:21:23.408162+0000","last_undegraded":"2024-04-26T22:21:23.408162+0000","last_fullsized":"2024-04-26T22:21:23.408162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297059+0000","last_change":"2024-04-26T22:21:22.405977+0000","last_active":"2024-04-26T22:21:24.297059+0000","last_peered":"2024-04-26T22:21:24.297059+0000","last_clean":"2024-04-26T22:21:24.297059+0000","last_became_active":"2024-04-26T22:21:22.405645+0000","last_became_peered":"2024-04-26T22:21:22.405645+0000","last_unstale":"2024-04-26T22:21:24.297059+0000","last_undegraded":"2024-04-26T22:21:24.297059+0000","last_fullsized":"2024-04-26T22:21:24.297059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:11.511211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412572+0000","last_change":"2024-04-26T22:21:21.405545+0000","last_active":"2024-04-26T22:21:23.412572+0000","last_peered":"2024-04-26T22:21:23.412572+0000","last_clean":"2024-04-26T22:21:23.412572+0000","last_became_active":"2024-04-26T22:21:21.403284+0000","last_became_peered":"2024-04-26T22:21:21.403284+0000","last_unstale":"2024-04-26T22:21:23.412572+0000","last_undegraded":"2024-04-26T22:21:23.412572+0000","last_fullsized":"2024-04-26T22:21:23.412572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204151+0000","last_change":"2024-04-26T22:21:22.415709+0000","last_active":"2024-04-26T22:21:24.204151+0000","last_peered":"2024-04-26T22:21:24.204151+0000","last_clean":"2024-04-26T22:21:24.204151+0000","last_became_active":"2024-04-26T22:21:22.414839+0000","last_became_peered":"2024-04-26T22:21:22.414839+0000","last_unstale":"2024-04-26T22:21:24.204151+0000","last_undegraded":"2024-04-26T22:21:24.204151+0000","last_fullsized":"2024-04-26T22:21:24.204151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:11:15.073482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408107+0000","last_change":"2024-04-26T22:21:21.397699+0000","last_active":"2024-04-26T22:21:23.408107+0000","last_peered":"2024-04-26T22:21:23.408107+0000","last_clean":"2024-04-26T22:21:23.408107+0000","last_became_active":"2024-04-26T22:21:21.397372+0000","last_became_peered":"2024-04-26T22:21:21.397372+0000","last_unstale":"2024-04-26T22:21:23.408107+0000","last_undegraded":"2024-04-26T22:21:23.408107+0000","last_fullsized":"2024-04-26T22:21:23.408107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296770+0000","last_change":"2024-04-26T22:21:22.420982+0000","last_active":"2024-04-26T22:21:24.296770+0000","last_peered":"2024-04-26T22:21:24.296770+0000","last_clean":"2024-04-26T22:21:24.296770+0000","last_became_active":"2024-04-26T22:21:22.420729+0000","last_became_peered":"2024-04-26T22:21:22.420729+0000","last_unstale":"2024-04-26T22:21:24.296770+0000","last_undegraded":"2024-04-26T22:21:24.296770+0000","last_fullsized":"2024-04-26T22:21:24.296770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.095762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296334+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:21:24.296334+0000","last_peered":"2024-04-26T22:21:24.296334+0000","last_clean":"2024-04-26T22:21:24.296334+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:21:24.296334+0000","last_undegraded":"2024-04-26T22:21:24.296334+0000","last_fullsized":"2024-04-26T22:21:24.296334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203426+0000","last_change":"2024-04-26T22:21:21.400430+0000","last_active":"2024-04-26T22:21:24.203426+0000","last_peered":"2024-04-26T22:21:24.203426+0000","last_clean":"2024-04-26T22:21:24.203426+0000","last_became_active":"2024-04-26T22:21:21.400160+0000","last_became_peered":"2024-04-26T22:21:21.400160+0000","last_unstale":"2024-04-26T22:21:24.203426+0000","last_undegraded":"2024-04-26T22:21:24.203426+0000","last_fullsized":"2024-04-26T22:21:24.203426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268202+0000","last_change":"2024-04-26T22:21:22.427326+0000","last_active":"2024-04-26T22:21:24.268202+0000","last_peered":"2024-04-26T22:21:24.268202+0000","last_clean":"2024-04-26T22:21:24.268202+0000","last_became_active":"2024-04-26T22:21:22.427067+0000","last_became_peered":"2024-04-26T22:21:22.427067+0000","last_unstale":"2024-04-26T22:21:24.268202+0000","last_undegraded":"2024-04-26T22:21:24.268202+0000","last_fullsized":"2024-04-26T22:21:24.268202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:14:44.812858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296218+0000","last_change":"2024-04-26T22:21:21.407696+0000","last_active":"2024-04-26T22:21:24.296218+0000","last_peered":"2024-04-26T22:21:24.296218+0000","last_clean":"2024-04-26T22:21:24.296218+0000","last_became_active":"2024-04-26T22:21:21.406397+0000","last_became_peered":"2024-04-26T22:21:21.406397+0000","last_unstale":"2024-04-26T22:21:24.296218+0000","last_undegraded":"2024-04-26T22:21:24.296218+0000","last_fullsized":"2024-04-26T22:21:24.296218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:07.497430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297336+0000","last_change":"2024-04-26T22:21:22.413618+0000","last_active":"2024-04-26T22:21:24.297336+0000","last_peered":"2024-04-26T22:21:24.297336+0000","last_clean":"2024-04-26T22:21:24.297336+0000","last_became_active":"2024-04-26T22:21:22.413285+0000","last_became_peered":"2024-04-26T22:21:22.413285+0000","last_unstale":"2024-04-26T22:21:24.297336+0000","last_undegraded":"2024-04-26T22:21:24.297336+0000","last_fullsized":"2024-04-26T22:21:24.297336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:07.261333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408143+0000","last_change":"2024-04-26T22:21:21.392079+0000","last_active":"2024-04-26T22:21:23.408143+0000","last_peered":"2024-04-26T22:21:23.408143+0000","last_clean":"2024-04-26T22:21:23.408143+0000","last_became_active":"2024-04-26T22:21:21.391760+0000","last_became_peered":"2024-04-26T22:21:21.391760+0000","last_unstale":"2024-04-26T22:21:23.408143+0000","last_undegraded":"2024-04-26T22:21:23.408143+0000","last_fullsized":"2024-04-26T22:21:23.408143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:16.802005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412645+0000","last_change":"2024-04-26T22:21:22.392865+0000","last_active":"2024-04-26T22:21:23.412645+0000","last_peered":"2024-04-26T22:21:23.412645+0000","last_clean":"2024-04-26T22:21:23.412645+0000","last_became_active":"2024-04-26T22:21:22.392571+0000","last_became_peered":"2024-04-26T22:21:22.392571+0000","last_unstale":"2024-04-26T22:21:23.412645+0000","last_undegraded":"2024-04-26T22:21:23.412645+0000","last_fullsized":"2024-04-26T22:21:23.412645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203951+0000","last_change":"2024-04-26T22:21:21.402750+0000","last_active":"2024-04-26T22:21:24.203951+0000","last_peered":"2024-04-26T22:21:24.203951+0000","last_clean":"2024-04-26T22:21:24.203951+0000","last_became_active":"2024-04-26T22:21:21.402348+0000","last_became_peered":"2024-04-26T22:21:21.402348+0000","last_unstale":"2024-04-26T22:21:24.203951+0000","last_undegraded":"2024-04-26T22:21:24.203951+0000","last_fullsized":"2024-04-26T22:21:24.203951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.409547+0000","last_change":"2024-04-26T22:21:22.418638+0000","last_active":"2024-04-26T22:21:23.409547+0000","last_peered":"2024-04-26T22:21:23.409547+0000","last_clean":"2024-04-26T22:21:23.409547+0000","last_became_active":"2024-04-26T22:21:22.418047+0000","last_became_peered":"2024-04-26T22:21:22.418047+0000","last_unstale":"2024-04-26T22:21:23.409547+0000","last_undegraded":"2024-04-26T22:21:23.409547+0000","last_fullsized":"2024-04-26T22:21:23.409547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:21.685361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412552+0000","last_change":"2024-04-26T22:21:21.404376+0000","last_active":"2024-04-26T22:21:23.412552+0000","last_peered":"2024-04-26T22:21:23.412552+0000","last_clean":"2024-04-26T22:21:23.412552+0000","last_became_active":"2024-04-26T22:21:21.404115+0000","last_became_peered":"2024-04-26T22:21:21.404115+0000","last_unstale":"2024-04-26T22:21:23.412552+0000","last_undegraded":"2024-04-26T22:21:23.412552+0000","last_fullsized":"2024-04-26T22:21:23.412552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:25.398342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.204135+0000","last_change":"2024-04-26T22:21:22.419797+0000","last_active":"2024-04-26T22:21:24.204135+0000","last_peered":"2024-04-26T22:21:24.204135+0000","last_clean":"2024-04-26T22:21:24.204135+0000","last_became_active":"2024-04-26T22:21:22.414517+0000","last_became_peered":"2024-04-26T22:21:22.414517+0000","last_unstale":"2024-04-26T22:21:24.204135+0000","last_undegraded":"2024-04-26T22:21:24.204135+0000","last_fullsized":"2024-04-26T22:21:24.204135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.095762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296961+0000","last_change":"2024-04-26T22:21:21.405504+0000","last_active":"2024-04-26T22:21:24.296961+0000","last_peered":"2024-04-26T22:21:24.296961+0000","last_clean":"2024-04-26T22:21:24.296961+0000","last_became_active":"2024-04-26T22:21:21.405051+0000","last_became_peered":"2024-04-26T22:21:21.405051+0000","last_unstale":"2024-04-26T22:21:24.296961+0000","last_undegraded":"2024-04-26T22:21:24.296961+0000","last_fullsized":"2024-04-26T22:21:24.296961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:21.339836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412393+0000","last_change":"2024-04-26T22:21:22.392844+0000","last_active":"2024-04-26T22:21:23.412393+0000","last_peered":"2024-04-26T22:21:23.412393+0000","last_clean":"2024-04-26T22:21:23.412393+0000","last_became_active":"2024-04-26T22:21:22.392544+0000","last_became_peered":"2024-04-26T22:21:22.392544+0000","last_unstale":"2024-04-26T22:21:23.412393+0000","last_undegraded":"2024-04-26T22:21:23.412393+0000","last_fullsized":"2024-04-26T22:21:23.412393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:32:43.918034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.414226+0000","last_change":"2024-04-26T22:21:21.402324+0000","last_active":"2024-04-26T22:21:23.414226+0000","last_peered":"2024-04-26T22:21:23.414226+0000","last_clean":"2024-04-26T22:21:23.414226+0000","last_became_active":"2024-04-26T22:21:21.402029+0000","last_became_peered":"2024-04-26T22:21:21.402029+0000","last_unstale":"2024-04-26T22:21:23.414226+0000","last_undegraded":"2024-04-26T22:21:23.414226+0000","last_fullsized":"2024-04-26T22:21:23.414226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268747+0000","last_change":"2024-04-26T22:21:22.429036+0000","last_active":"2024-04-26T22:21:24.268747+0000","last_peered":"2024-04-26T22:21:24.268747+0000","last_clean":"2024-04-26T22:21:24.268747+0000","last_became_active":"2024-04-26T22:21:22.417035+0000","last_became_peered":"2024-04-26T22:21:22.417035+0000","last_unstale":"2024-04-26T22:21:24.268747+0000","last_undegraded":"2024-04-26T22:21:24.268747+0000","last_fullsized":"2024-04-26T22:21:24.268747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:54.179538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408971+0000","last_change":"2024-04-26T22:21:21.396691+0000","last_active":"2024-04-26T22:21:23.408971+0000","last_peered":"2024-04-26T22:21:23.408971+0000","last_clean":"2024-04-26T22:21:23.408971+0000","last_became_active":"2024-04-26T22:21:21.395935+0000","last_became_peered":"2024-04-26T22:21:21.395935+0000","last_unstale":"2024-04-26T22:21:23.408971+0000","last_undegraded":"2024-04-26T22:21:23.408971+0000","last_fullsized":"2024-04-26T22:21:23.408971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297834+0000","last_change":"2024-04-26T22:21:22.418914+0000","last_active":"2024-04-26T22:21:24.297834+0000","last_peered":"2024-04-26T22:21:24.297834+0000","last_clean":"2024-04-26T22:21:24.297834+0000","last_became_active":"2024-04-26T22:21:22.418549+0000","last_became_peered":"2024-04-26T22:21:22.418549+0000","last_unstale":"2024-04-26T22:21:24.297834+0000","last_undegraded":"2024-04-26T22:21:24.297834+0000","last_fullsized":"2024-04-26T22:21:24.297834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:25:00.232825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296208+0000","last_change":"2024-04-26T22:21:21.406456+0000","last_active":"2024-04-26T22:21:24.296208+0000","last_peered":"2024-04-26T22:21:24.296208+0000","last_clean":"2024-04-26T22:21:24.296208+0000","last_became_active":"2024-04-26T22:21:21.406032+0000","last_became_peered":"2024-04-26T22:21:21.406032+0000","last_unstale":"2024-04-26T22:21:24.296208+0000","last_undegraded":"2024-04-26T22:21:24.296208+0000","last_fullsized":"2024-04-26T22:21:24.296208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:20.679929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408998+0000","last_change":"2024-04-26T22:21:22.394656+0000","last_active":"2024-04-26T22:21:23.408998+0000","last_peered":"2024-04-26T22:21:23.408998+0000","last_clean":"2024-04-26T22:21:23.408998+0000","last_became_active":"2024-04-26T22:21:22.394308+0000","last_became_peered":"2024-04-26T22:21:22.394308+0000","last_unstale":"2024-04-26T22:21:23.408998+0000","last_undegraded":"2024-04-26T22:21:23.408998+0000","last_fullsized":"2024-04-26T22:21:23.408998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:26.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412559+0000","last_change":"2024-04-26T22:21:21.410610+0000","last_active":"2024-04-26T22:21:23.412559+0000","last_peered":"2024-04-26T22:21:23.412559+0000","last_clean":"2024-04-26T22:21:23.412559+0000","last_became_active":"2024-04-26T22:21:21.410307+0000","last_became_peered":"2024-04-26T22:21:21.410307+0000","last_unstale":"2024-04-26T22:21:23.412559+0000","last_undegraded":"2024-04-26T22:21:23.412559+0000","last_fullsized":"2024-04-26T22:21:23.412559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:09.633576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268253+0000","last_change":"2024-04-26T22:21:22.403920+0000","last_active":"2024-04-26T22:21:24.268253+0000","last_peered":"2024-04-26T22:21:24.268253+0000","last_clean":"2024-04-26T22:21:24.268253+0000","last_became_active":"2024-04-26T22:21:22.403666+0000","last_became_peered":"2024-04-26T22:21:22.403666+0000","last_unstale":"2024-04-26T22:21:24.268253+0000","last_undegraded":"2024-04-26T22:21:24.268253+0000","last_fullsized":"2024-04-26T22:21:24.268253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:30.326396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.412507+0000","last_change":"2024-04-26T22:21:21.402151+0000","last_active":"2024-04-26T22:21:23.412507+0000","last_peered":"2024-04-26T22:21:23.412507+0000","last_clean":"2024-04-26T22:21:23.412507+0000","last_became_active":"2024-04-26T22:21:21.401806+0000","last_became_peered":"2024-04-26T22:21:21.401806+0000","last_unstale":"2024-04-26T22:21:23.412507+0000","last_undegraded":"2024-04-26T22:21:23.412507+0000","last_fullsized":"2024-04-26T22:21:23.412507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:58.983170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268394+0000","last_change":"2024-04-26T22:21:22.429169+0000","last_active":"2024-04-26T22:21:24.268394+0000","last_peered":"2024-04-26T22:21:24.268394+0000","last_clean":"2024-04-26T22:21:24.268394+0000","last_became_active":"2024-04-26T22:21:22.428796+0000","last_became_peered":"2024-04-26T22:21:22.428796+0000","last_unstale":"2024-04-26T22:21:24.268394+0000","last_undegraded":"2024-04-26T22:21:24.268394+0000","last_fullsized":"2024-04-26T22:21:24.268394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:04.706976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296667+0000","last_change":"2024-04-26T22:21:21.408709+0000","last_active":"2024-04-26T22:21:24.296667+0000","last_peered":"2024-04-26T22:21:24.296667+0000","last_clean":"2024-04-26T22:21:24.296667+0000","last_became_active":"2024-04-26T22:21:21.408242+0000","last_became_peered":"2024-04-26T22:21:21.408242+0000","last_unstale":"2024-04-26T22:21:24.296667+0000","last_undegraded":"2024-04-26T22:21:24.296667+0000","last_fullsized":"2024-04-26T22:21:24.296667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:38.502586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:23.408033+0000","last_change":"2024-04-26T22:21:22.406897+0000","last_active":"2024-04-26T22:21:23.408033+0000","last_peered":"2024-04-26T22:21:23.408033+0000","last_clean":"2024-04-26T22:21:23.408033+0000","last_became_active":"2024-04-26T22:21:22.406614+0000","last_became_peered":"2024-04-26T22:21:22.406614+0000","last_unstale":"2024-04-26T22:21:23.408033+0000","last_undegraded":"2024-04-26T22:21:23.408033+0000","last_fullsized":"2024-04-26T22:21:23.408033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:45.453509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203882+0000","last_change":"2024-04-26T22:21:22.404257+0000","last_active":"2024-04-26T22:21:24.203882+0000","last_peered":"2024-04-26T22:21:24.203882+0000","last_clean":"2024-04-26T22:21:24.203882+0000","last_became_active":"2024-04-26T22:21:22.403954+0000","last_became_peered":"2024-04-26T22:21:22.403954+0000","last_unstale":"2024-04-26T22:21:24.203882+0000","last_undegraded":"2024-04-26T22:21:24.203882+0000","last_fullsized":"2024-04-26T22:21:24.203882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:08.480631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296590+0000","last_change":"2024-04-26T22:21:21.406486+0000","last_active":"2024-04-26T22:21:24.296590+0000","last_peered":"2024-04-26T22:21:24.296590+0000","last_clean":"2024-04-26T22:21:24.296590+0000","last_became_active":"2024-04-26T22:21:21.406190+0000","last_became_peered":"2024-04-26T22:21:21.406190+0000","last_unstale":"2024-04-26T22:21:24.296590+0000","last_undegraded":"2024-04-26T22:21:24.296590+0000","last_fullsized":"2024-04-26T22:21:24.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:45.631147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.203739+0000","last_change":"2024-04-26T22:21:22.415974+0000","last_active":"2024-04-26T22:21:24.203739+0000","last_peered":"2024-04-26T22:21:24.203739+0000","last_clean":"2024-04-26T22:21:24.203739+0000","last_became_active":"2024-04-26T22:21:22.415384+0000","last_became_peered":"2024-04-26T22:21:22.415384+0000","last_unstale":"2024-04-26T22:21:24.203739+0000","last_undegraded":"2024-04-26T22:21:24.203739+0000","last_fullsized":"2024-04-26T22:21:24.203739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.296856+0000","last_change":"2024-04-26T22:21:21.405267+0000","last_active":"2024-04-26T22:21:24.296856+0000","last_peered":"2024-04-26T22:21:24.296856+0000","last_clean":"2024-04-26T22:21:24.296856+0000","last_became_active":"2024-04-26T22:21:21.404669+0000","last_became_peered":"2024-04-26T22:21:21.404669+0000","last_unstale":"2024-04-26T22:21:24.296856+0000","last_undegraded":"2024-04-26T22:21:24.296856+0000","last_fullsized":"2024-04-26T22:21:24.296856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:56.139020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297917+0000","last_change":"2024-04-26T22:21:22.422015+0000","last_active":"2024-04-26T22:21:24.297917+0000","last_peered":"2024-04-26T22:21:24.297917+0000","last_clean":"2024-04-26T22:21:24.297917+0000","last_became_active":"2024-04-26T22:21:22.421713+0000","last_became_peered":"2024-04-26T22:21:22.421713+0000","last_unstale":"2024-04-26T22:21:24.297917+0000","last_undegraded":"2024-04-26T22:21:24.297917+0000","last_fullsized":"2024-04-26T22:21:24.297917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:24:49.399695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268621+0000","last_change":"2024-04-26T22:21:21.396531+0000","last_active":"2024-04-26T22:21:24.268621+0000","last_peered":"2024-04-26T22:21:24.268621+0000","last_clean":"2024-04-26T22:21:24.268621+0000","last_became_active":"2024-04-26T22:21:21.395948+0000","last_became_peered":"2024-04-26T22:21:21.395948+0000","last_unstale":"2024-04-26T22:21:24.268621+0000","last_undegraded":"2024-04-26T22:21:24.268621+0000","last_fullsized":"2024-04-26T22:21:24.268621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.268634+0000","last_change":"2024-04-26T22:21:22.406649+0000","last_active":"2024-04-26T22:21:24.268634+0000","last_peered":"2024-04-26T22:21:24.268634+0000","last_clean":"2024-04-26T22:21:24.268634+0000","last_became_active":"2024-04-26T22:21:22.406377+0000","last_became_peered":"2024-04-26T22:21:22.406377+0000","last_unstale":"2024-04-26T22:21:24.268634+0000","last_undegraded":"2024-04-26T22:21:24.268634+0000","last_fullsized":"2024-04-26T22:21:24.268634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:21.369688+0000","last_clean_scrub_stamp":"2024-04-26T22:21:21.369688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:54.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T22:21:24.297985+0000","last_change":"2024-04-26T22:21:21.401403+0000","last_active":"2024-04-26T22:21:24.297985+0000","last_peered":"2024-04-26T22:21:24.297985+0000","last_clean":"2024-04-26T22:21:24.297985+0000","last_became_active":"2024-04-26T22:21:21.401028+0000","last_became_peered":"2024-04-26T22:21:21.401028+0000","last_unstale":"2024-04-26T22:21:24.297985+0000","last_undegraded":"2024-04-26T22:21:24.297985+0000","last_fullsized":"2024-04-26T22:21:24.297985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:20.364255+0000","last_clean_scrub_stamp":"2024-04-26T22:21:20.364255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:19.445168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:21:31.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T22:21:31.616 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T22:21:31.616 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T22:21:31.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:21:31.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.796+0000 7f62d1e00640 1 Processor -- start 2024-04-26T22:21:31.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.796+0000 7f62d1e00640 1 -- start start 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.796+0000 7f62d1e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc06e450 0x7f62cc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62d1e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f62cc0b0ac0 0x7f62cc150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62d1e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62cc0b3f50 con 0x7f62cc0b58d0 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62d1e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f62cc0b3310 con 0x7f62cc06e450 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62d1e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f62cc070790 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc06e450 0x7f62cc0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc06e450 0x7f62cc0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41914/0 (socket says 172.21.15.16:41914) 2024-04-26T22:21:31.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 -- 172.21.15.16:0/3921222524 learned_addr learned my addr 172.21.15.16:0/3921222524 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62c3e00640 1 --1- 172.21.15.16:0/3921222524 >> v1:172.21.15.16:6789/0 conn(0x7f62cc0b58d0 0x7f62cc140060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59532/0 (socket says 172.21.15.16:59532) 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62cb400640 1 --2- 172.21.15.16:0/3921222524 >> v2:172.21.15.195:3300/0 conn(0x7f62cc0b0ac0 0x7f62cc150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 -- 172.21.15.16:0/3921222524 >> v2:172.21.15.195:3300/0 conn(0x7f62cc0b0ac0 msgr2=0x7f62cc150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 --2- 172.21.15.16:0/3921222524 >> v2:172.21.15.195:3300/0 conn(0x7f62cc0b0ac0 0x7f62cc150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 -- 172.21.15.16:0/3921222524 >> v1:172.21.15.16:6789/0 conn(0x7f62cc0b58d0 legacy=0x7f62cc140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 -- 172.21.15.16:0/3921222524 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc06e830 con 0x7f62cc06e450 2024-04-26T22:21:31.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62caa00640 1 --2- 172.21.15.16:0/3921222524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06e450 0x7f62cc0b3a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0b0a50 tx=0x7f62bc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74877c7b03dff4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62ca000640 1 -- 172.21.15.16:0/3921222524 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0ab660 con 0x7f62cc06e450 2024-04-26T22:21:31.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62ca000640 1 -- 172.21.15.16:0/3921222524 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc0b0070 con 0x7f62cc06e450 2024-04-26T22:21:31.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.800+0000 7f62ca000640 1 -- 172.21.15.16:0/3921222524 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0aba20 con 0x7f62cc06e450 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- 172.21.15.16:0/3921222524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06e450 msgr2=0x7f62cc0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- 172.21.15.16:0/3921222524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06e450 0x7f62cc0b3a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0b0a50 tx=0x7f62bc01c460 comp rx=0 tx=0).stop 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- 172.21.15.16:0/3921222524 shutdown_connections 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- 172.21.15.16:0/3921222524 >> v2:172.21.15.195:3300/0 conn(0x7f62cc0b0ac0 0x7f62cc150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- 172.21.15.16:0/3921222524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06e450 0x7f62cc0b3a10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- 172.21.15.16:0/3921222524 >> 172.21.15.16:0/3921222524 conn(0x7f62cc0b6620 msgr2=0x7f62cc0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:31.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- 172.21.15.16:0/3921222524 shutdown_connections 2024-04-26T22:21:31.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- 172.21.15.16:0/3921222524 wait complete. 2024-04-26T22:21:31.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 Processor -- start 2024-04-26T22:21:31.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- start start 2024-04-26T22:21:31.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc06e450 0x7f62cc0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 0x7f62cc1e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc153a30 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc1538b0 con 0x7f62cc06e450 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62d1e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f62cc153bb0 con 0x7f62cc0b58d0 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41926/0 (socket says 172.21.15.16:41926) 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 -- 172.21.15.16:0/2912426250 learned_addr learned my addr 172.21.15.16:0/2912426250 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62caa00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc06e450 0x7f62cc0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62cb400640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 0x7f62cc1e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 -- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 msgr2=0x7f62cc1e1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 0x7f62cc1e1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 -- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc06e450 msgr2=0x7f62cc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc06e450 0x7f62cc0b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 -- 172.21.15.16:0/2912426250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc1e5290 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62cb400640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 0x7f62cc1e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.804+0000 7f62c3e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c370 tx=0x7f62b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b40074e0 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b4007680 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4004a30 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc1e5570 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc0730a0 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc069530 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f62b401a020 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 0x7f62a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:31.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f62b40860f0 con 0x7f62cc0b0ac0 2024-04-26T22:21:31.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.808+0000 7f62caa00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 0x7f62a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:31.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.812+0000 7f62caa00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 0x7f62a806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af000 tx=0x7f62bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:31.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:31.812+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f62b40566a0 con 0x7f62cc0b0ac0 2024-04-26T22:21:32.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62cc070c40 con 0x7f62cc0b0ac0 2024-04-26T22:21:32.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62c3400640 1 -- 172.21.15.16:0/2912426250 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f62b4055fa0 con 0x7f62cc0b0ac0 2024-04-26T22:21:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:32.014 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T22:21:32.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 msgr2=0x7f62a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 0x7f62a806a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af000 tx=0x7f62bc0a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 msgr2=0x7f62cc1e1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f62b400c370 tx=0x7f62b400c830 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 shutdown_connections 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f62a8068380 0x7f62a806a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f62cc0b58d0 0x7f62cc1e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0b0ac0 0x7f62cc1e1780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 --2- 172.21.15.16:0/2912426250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62cc06e450 0x7f62cc0b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.012+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 >> 172.21.15.16:0/2912426250 conn(0x7f62cc0b6620 msgr2=0x7f62cc0afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.016+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 shutdown_connections 2024-04-26T22:21:32.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.016+0000 7f62d1e00640 1 -- 172.21.15.16:0/2912426250 wait complete. 2024-04-26T22:21:32.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T22:21:32.034 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 Processor -- start 2024-04-26T22:21:32.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 -- start start 2024-04-26T22:21:32.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 0x7f34d014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d014c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34d0141f30 0x7f34d0142330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f34d006cbd0 con 0x7f34d0141f30 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00b75a0 con 0x7f34d00b85c0 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cf200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00b7880 con 0x7f34d00b7080 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34d0141f30 0x7f34d0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34d0141f30 0x7f34d0142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41934/0 (socket says 172.21.15.16:41934) 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 -- 172.21.15.16:0/622844641 learned_addr learned my addr 172.21.15.16:0/622844641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cde00640 1 --2- 172.21.15.16:0/622844641 >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 0x7f34d014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cd400640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 -- 172.21.15.16:0/622844641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 msgr2=0x7f34d014c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d014c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 -- 172.21.15.16:0/622844641 >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 msgr2=0x7f34d014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 --2- 172.21.15.16:0/622844641 >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 0x7f34d014bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34ce800640 1 -- 172.21.15.16:0/622844641 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d0142870 con 0x7f34d0141f30 2024-04-26T22:21:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.176+0000 7f34cde00640 1 --2- 172.21.15.16:0/622844641 >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 0x7f34d014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34ce800640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d0141f30 0x7f34d0142330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34d0068f40 tx=0x7f34c801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecb2b95fe0b1bd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cca00640 1 -- 172.21.15.16:0/622844641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80a5710 con 0x7f34d0141f30 2024-04-26T22:21:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cca00640 1 -- 172.21.15.16:0/622844641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c80a58b0 con 0x7f34d0141f30 2024-04-26T22:21:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cca00640 1 -- 172.21.15.16:0/622844641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80a5c80 con 0x7f34d0141f30 2024-04-26T22:21:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- 172.21.15.16:0/622844641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d0141f30 msgr2=0x7f34d0142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d0141f30 0x7f34d0142330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34d0068f40 tx=0x7f34c801c960 comp rx=0 tx=0).stop 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- 172.21.15.16:0/622844641 shutdown_connections 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d0141f30 0x7f34d0142330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 --2- 172.21.15.16:0/622844641 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 --2- 172.21.15.16:0/622844641 >> v2:172.21.15.195:3300/0 conn(0x7f34d00b85c0 0x7f34d014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- 172.21.15.16:0/622844641 >> 172.21.15.16:0/622844641 conn(0x7f34d0068140 msgr2=0x7f34d0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- 172.21.15.16:0/622844641 shutdown_connections 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- 172.21.15.16:0/622844641 wait complete. 2024-04-26T22:21:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 Processor -- start 2024-04-26T22:21:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.180+0000 7f34cf200640 1 -- start start 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d01e4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 0x7f34d013e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00b6e70 con 0x7f34d00b85c0 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00b6cf0 con 0x7f34d0141f30 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f34d0072cb0 con 0x7f34d00b7080 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41944/0 (socket says 172.21.15.16:41944) 2024-04-26T22:21:32.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 -- 172.21.15.16:0/1710621534 learned_addr learned my addr 172.21.15.16:0/1710621534 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cde00640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d01e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34ce800640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 0x7f34d013e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 -- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 msgr2=0x7f34d01e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d01e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 -- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 msgr2=0x7f34d013e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 0x7f34d013e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 -- 172.21.15.16:0/1710621534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00b4640 con 0x7f34d00b85c0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34ce800640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 0x7f34d013e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cd400640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d800 tx=0x7f34bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00b6c0 con 0x7f34d00b85c0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc019070 con 0x7f34d00b85c0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d00b4aa0 con 0x7f34d00b85c0 2024-04-26T22:21:32.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00ba60 con 0x7f34d00b85c0 2024-04-26T22:21:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d00aeb70 con 0x7f34d00b85c0 2024-04-26T22:21:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d00694f0 con 0x7f34d00b85c0 2024-04-26T22:21:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.184+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34bc00bc00 con 0x7f34d00b85c0 2024-04-26T22:21:32.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.188+0000 7f34c6000640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 0x7f34b006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.188+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f34bc086ec0 con 0x7f34d00b85c0 2024-04-26T22:21:32.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.188+0000 7f34cde00640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 0x7f34b006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.188+0000 7f34cde00640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 0x7f34b006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34d00b2ff0 tx=0x7f34c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.192+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f34bc057470 con 0x7f34d00b85c0 2024-04-26T22:21:32.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.356+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34d0152950 con 0x7f34d00b85c0 2024-04-26T22:21:32.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34c6000640 1 -- 172.21.15.16:0/1710621534 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f34bc056d70 con 0x7f34d00b85c0 2024-04-26T22:21:32.360 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:32.360 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 msgr2=0x7f34b006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 0x7f34b006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34d00b2ff0 tx=0x7f34c0008040 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 msgr2=0x7f34d01e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d800 tx=0x7f34bc00dcc0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 shutdown_connections 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f34b0068380 0x7f34b006a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34d0141f30 0x7f34d013e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34d00b85c0 0x7f34d01e4a40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 --2- 172.21.15.16:0/1710621534 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f34d00b7080 0x7f34d01e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 >> 172.21.15.16:0/1710621534 conn(0x7f34d0068140 msgr2=0x7f34d006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 shutdown_connections 2024-04-26T22:21:32.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.360+0000 7f34cf200640 1 -- 172.21.15.16:0/1710621534 wait complete. 2024-04-26T22:21:32.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:32.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.524+0000 7f3f4ca00640 1 Processor -- start 2024-04-26T22:21:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 -- start start 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 0x7f3f48070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f48152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f480a12d0 con 0x7f3f48073860 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3f480b7210 con 0x7f3f480b7880 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f4ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f480b76a0 con 0x7f3f48070550 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f45e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f3f48073860 0x7f3f48142440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47560/0 (socket says 172.21.15.16:47560) 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f46800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f48152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f3d400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 0x7f3f48070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f45e00640 1 -- 172.21.15.16:0/1886339163 learned_addr learned my addr 172.21.15.16:0/1886339163 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f45400640 1 -- 172.21.15.16:0/1886339163 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745229803 0 0) 0x7f3f480a12d0 con 0x7f3f48073860 2024-04-26T22:21:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f45400640 1 -- 172.21.15.16:0/1886339163 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c003530 con 0x7f3f48073860 2024-04-26T22:21:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f46800640 1 -- 172.21.15.16:0/1886339163 >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 msgr2=0x7f3f48070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f46800640 1 --2- 172.21.15.16:0/1886339163 >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 0x7f3f48070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f46800640 1 -- 172.21.15.16:0/1886339163 >> v1:172.21.15.195:6789/0 conn(0x7f3f48073860 legacy=0x7f3f48142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f46800640 1 -- 172.21.15.16:0/1886339163 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f480b6ed0 con 0x7f3f48070550 2024-04-26T22:21:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.528+0000 7f3f3d400640 1 --2- 172.21.15.16:0/1886339163 >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 0x7f3f48070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:32.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f46800640 1 --2- 172.21.15.16:0/1886339163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f48152df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f480b7390 tx=0x7f3f4001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b18cbef8588ec5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f45400640 1 -- 172.21.15.16:0/1886339163 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400b2070 con 0x7f3f48070550 2024-04-26T22:21:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f45400640 1 -- 172.21.15.16:0/1886339163 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400a5980 con 0x7f3f48070550 2024-04-26T22:21:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f45400640 1 -- 172.21.15.16:0/1886339163 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400a5d30 con 0x7f3f48070550 2024-04-26T22:21:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1886339163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 msgr2=0x7f3f48152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1886339163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f48152df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f480b7390 tx=0x7f3f4001c8c0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1886339163 shutdown_connections 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1886339163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f48152df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1886339163 >> v2:172.21.15.195:3300/0 conn(0x7f3f480b7880 0x7f3f48070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1886339163 >> 172.21.15.16:0/1886339163 conn(0x7f3f480b8850 msgr2=0x7f3f480b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1886339163 shutdown_connections 2024-04-26T22:21:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1886339163 wait complete. 2024-04-26T22:21:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 Processor -- start 2024-04-26T22:21:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.532+0000 7f3f4ca00640 1 -- start start 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f480bb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f48073860 0x7f3f481e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48071280 con 0x7f3f4813c760 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48071100 con 0x7f3f48073860 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f48142b50 con 0x7f3f48070550 2024-04-26T22:21:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41956/0 (socket says 172.21.15.16:41956) 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 -- 172.21.15.16:0/1489590158 learned_addr learned my addr 172.21.15.16:0/1489590158 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f3d400640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f48073860 0x7f3f481e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f45e00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f480bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 -- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 msgr2=0x7f3f480bb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f480bb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 -- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f48073860 msgr2=0x7f3f481e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f48073860 0x7f3f481e41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 -- 172.21.15.16:0/1489590158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4813d5b0 con 0x7f3f4813c760 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f46800640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f400b0040 tx=0x7f3f40019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400b2050 con 0x7f3f4813c760 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400be070 con 0x7f3f4813c760 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4813e6b0 con 0x7f3f4813c760 2024-04-26T22:21:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40009450 con 0x7f3f4813c760 2024-04-26T22:21:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4813d820 con 0x7f3f4813c760 2024-04-26T22:21:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.536+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f48069530 con 0x7f3f4813c760 2024-04-26T22:21:32.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.540+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f400adca0 con 0x7f3f4813c760 2024-04-26T22:21:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.540+0000 7f3f3ea00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 0x7f3f2406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.540+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3f40121510 con 0x7f3f4813c760 2024-04-26T22:21:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.540+0000 7f3f45e00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 0x7f3f2406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.540+0000 7f3f45e00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 0x7f3f2406a870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f380011f0 tx=0x7f3f38007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.544+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3f400c7020 con 0x7f3f4813c760 2024-04-26T22:21:32.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.708+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3f48141920 con 0x7f3f4813c760 2024-04-26T22:21:32.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.708+0000 7f3f3ea00640 1 -- 172.21.15.16:0/1489590158 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f3f40016540 con 0x7f3f4813c760 2024-04-26T22:21:32.711 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 msgr2=0x7f3f2406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 0x7f3f2406a870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f380011f0 tx=0x7f3f38007d40 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 msgr2=0x7f3f481e4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f400b0040 tx=0x7f3f40019660 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 shutdown_connections 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3f240683b0 0x7f3f2406a870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f4813c760 0x7f3f481e4720 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f48073860 0x7f3f481e41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 --2- 172.21.15.16:0/1489590158 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f48070550 0x7f3f480bb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 >> 172.21.15.16:0/1489590158 conn(0x7f3f480b8850 msgr2=0x7f3f480b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 shutdown_connections 2024-04-26T22:21:32.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.712+0000 7f3f4ca00640 1 -- 172.21.15.16:0/1489590158 wait complete. 2024-04-26T22:21:32.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.872+0000 7f7a85800640 1 Processor -- start 2024-04-26T22:21:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.872+0000 7f7a85800640 1 -- start start 2024-04-26T22:21:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a85800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a80073860 0x7f7a80142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a85800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80142980 0x7f7a80152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a85800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a800a12d0 con 0x7f7a800b7880 2024-04-26T22:21:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a85800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7a800b7210 con 0x7f7a80073860 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a85800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a800b76a0 con 0x7f7a80142980 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a80073860 0x7f7a80142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a80073860 0x7f7a80142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41966/0 (socket says 172.21.15.16:41966) 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 -- 172.21.15.16:0/2185356248 learned_addr learned my addr 172.21.15.16:0/2185356248 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 -- 172.21.15.16:0/2185356248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80142980 msgr2=0x7f7a80152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 --2- 172.21.15.16:0/2185356248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80142980 0x7f7a80152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 -- 172.21.15.16:0/2185356248 >> v1:172.21.15.195:6789/0 conn(0x7f7a800b7880 legacy=0x7f7a80070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.876+0000 7f7a7ea00640 1 -- 172.21.15.16:0/2185356248 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a800b6ed0 con 0x7f7a80073860 2024-04-26T22:21:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7ea00640 1 --2- 172.21.15.16:0/2185356248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a80073860 0x7f7a80142440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a800b7390 tx=0x7f7a7001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167ff825fcf985b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7e000640 1 -- 172.21.15.16:0/2185356248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700ab430 con 0x7f7a80073860 2024-04-26T22:21:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7e000640 1 -- 172.21.15.16:0/2185356248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a700b0070 con 0x7f7a80073860 2024-04-26T22:21:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7e000640 1 -- 172.21.15.16:0/2185356248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700ab7f0 con 0x7f7a80073860 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- 172.21.15.16:0/2185356248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a80073860 msgr2=0x7f7a80142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- 172.21.15.16:0/2185356248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a80073860 0x7f7a80142440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7a800b7390 tx=0x7f7a7001c470 comp rx=0 tx=0).stop 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- 172.21.15.16:0/2185356248 shutdown_connections 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- 172.21.15.16:0/2185356248 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80142980 0x7f7a80152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- 172.21.15.16:0/2185356248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a80073860 0x7f7a80142440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- 172.21.15.16:0/2185356248 >> 172.21.15.16:0/2185356248 conn(0x7f7a800b8850 msgr2=0x7f7a800b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- 172.21.15.16:0/2185356248 shutdown_connections 2024-04-26T22:21:32.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- 172.21.15.16:0/2185356248 wait complete. 2024-04-26T22:21:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 Processor -- start 2024-04-26T22:21:32.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- start start 2024-04-26T22:21:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80073860 0x7f7a8013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a80142980 0x7f7a8013da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80071280 con 0x7f7a8013ca80 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a80071100 con 0x7f7a80142980 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a85800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a80070720 con 0x7f7a80073860 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41980/0 (socket says 172.21.15.16:41980) 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a77e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a80142980 0x7f7a8013da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7f400640 1 -- 172.21.15.16:0/745900552 learned_addr learned my addr 172.21.15.16:0/745900552 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.880+0000 7f7a7ea00640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80073860 0x7f7a8013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 -- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80073860 msgr2=0x7f7a8013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80073860 0x7f7a8013d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 -- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a80142980 msgr2=0x7f7a8013da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:32.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a80142980 0x7f7a8013da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 -- 172.21.15.16:0/745900552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8013dfa0 con 0x7f7a8013ca80 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7f400640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800b970 tx=0x7f7a7800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78019070 con 0x7f7a8013ca80 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7800cb60 con 0x7f7a8013ca80 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78014440 con 0x7f7a8013ca80 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8013e220 con 0x7f7a8013ca80 2024-04-26T22:21:32.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8006d210 con 0x7f7a8013ca80 2024-04-26T22:21:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a80069530 con 0x7f7a8013ca80 2024-04-26T22:21:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a7801c070 con 0x7f7a8013ca80 2024-04-26T22:21:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 0x7f7a5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a780865f0 con 0x7f7a8013ca80 2024-04-26T22:21:32.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.884+0000 7f7a7ea00640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 0x7f7a5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:32.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.888+0000 7f7a7ea00640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 0x7f7a5c06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a700af000 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:32.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:32.888+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a8013dfa0 con 0x7f7a8013ca80 2024-04-26T22:21:33.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7a800a0960 con 0x7f7a8013ca80 2024-04-26T22:21:33.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a76a00640 1 -- 172.21.15.16:0/745900552 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7a780565d0 con 0x7f7a8013ca80 2024-04-26T22:21:33.056 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 msgr2=0x7f7a5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 0x7f7a5c06a870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a700af000 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2024-04-26T22:21:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 msgr2=0x7f7a801e44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800b970 tx=0x7f7a7800be30 comp rx=0 tx=0).stop 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 shutdown_connections 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a5c0683b0 0x7f7a5c06a870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a8013ca80 0x7f7a801e44a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a80142980 0x7f7a8013da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 --2- 172.21.15.16:0/745900552 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a80073860 0x7f7a8013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 >> 172.21.15.16:0/745900552 conn(0x7f7a800b8850 msgr2=0x7f7a8009fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 shutdown_connections 2024-04-26T22:21:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.056+0000 7f7a85800640 1 -- 172.21.15.16:0/745900552 wait complete. 2024-04-26T22:21:33.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 Processor -- start 2024-04-26T22:21:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 -- start start 2024-04-26T22:21:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 0x7fda60149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6006e7f0 con 0x7fda6013eec0 2024-04-26T22:21:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fda60070a40 con 0x7fda601465c0 2024-04-26T22:21:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda64c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda60070760 con 0x7fda6006e410 2024-04-26T22:21:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda55400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 0x7fda60149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5e800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fda6013eec0 0x7fda6013f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:47580/0 (socket says 172.21.15.16:47580) 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5e800640 1 -- 172.21.15.16:0/562752181 learned_addr learned my addr 172.21.15.16:0/562752181 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42242/0 (socket says 172.21.15.16:42242) 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 -- 172.21.15.16:0/562752181 >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 msgr2=0x7fda60149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 --2- 172.21.15.16:0/562752181 >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 0x7fda60149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 -- 172.21.15.16:0/562752181 >> v1:172.21.15.195:6789/0 conn(0x7fda6013eec0 legacy=0x7fda6013f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5d400640 1 -- 172.21.15.16:0/562752181 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416135993 0 0) 0x7fda6006e7f0 con 0x7fda6013eec0 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda5de00640 1 -- 172.21.15.16:0/562752181 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda60148860 con 0x7fda6006e410 2024-04-26T22:21:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.220+0000 7fda55400640 1 --2- 172.21.15.16:0/562752181 >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 0x7fda60149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda5de00640 1 --2- 172.21.15.16:0/562752181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ba60 tx=0x7fda5001eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d68ffbd5b399dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda5d400640 1 -- 172.21.15.16:0/562752181 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500b4070 con 0x7fda6006e410 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda5d400640 1 -- 172.21.15.16:0/562752181 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda500a7980 con 0x7fda6006e410 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda5d400640 1 -- 172.21.15.16:0/562752181 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500a7d50 con 0x7fda6006e410 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 -- 172.21.15.16:0/562752181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 msgr2=0x7fda600b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 --2- 172.21.15.16:0/562752181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ba60 tx=0x7fda5001eae0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 -- 172.21.15.16:0/562752181 shutdown_connections 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 --2- 172.21.15.16:0/562752181 >> v2:172.21.15.195:3300/0 conn(0x7fda601465c0 0x7fda60149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 --2- 172.21.15.16:0/562752181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda6006e410 0x7fda600b30d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 -- 172.21.15.16:0/562752181 >> 172.21.15.16:0/562752181 conn(0x7fda600b6590 msgr2=0x7fda600b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 -- 172.21.15.16:0/562752181 shutdown_connections 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.224+0000 7fda64c00640 1 -- 172.21.15.16:0/562752181 wait complete. 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 Processor -- start 2024-04-26T22:21:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- start start 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 0x7fda6013c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 0x7fda60138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda600b5030 con 0x7fda6006e410 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda600b4eb0 con 0x7fda6013eec0 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda600b51b0 con 0x7fda601465c0 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41994/0 (socket says 172.21.15.16:41994) 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 -- 172.21.15.16:0/611726480 learned_addr learned my addr 172.21.15.16:0/611726480 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5e800640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 0x7fda60138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda55400640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 0x7fda6013c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 -- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 msgr2=0x7fda60138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 0x7fda60138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 -- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 msgr2=0x7fda6013c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 0x7fda6013c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 -- 172.21.15.16:0/611726480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6014f680 con 0x7fda6006e410 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5e800640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 0x7fda60138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda55400640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 0x7fda6013c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda5de00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda500b2040 tx=0x7fda5001b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500bf070 con 0x7fda6006e410 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda500af720 con 0x7fda6006e410 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6013b670 con 0x7fda6006e410 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda500b4040 con 0x7fda6006e410 2024-04-26T22:21:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda60139630 con 0x7fda6006e410 2024-04-26T22:21:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.228+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6014f470 con 0x7fda6006e410 2024-04-26T22:21:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.232+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda500c2070 con 0x7fda6006e410 2024-04-26T22:21:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.232+0000 7fda56a00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 0x7fda3c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.232+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fda50120950 con 0x7fda6006e410 2024-04-26T22:21:33.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.232+0000 7fda55400640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 0x7fda3c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.232+0000 7fda55400640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 0x7fda3c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda6013d2b0 tx=0x7fda4800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.236+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fda50018760 con 0x7fda6006e410 2024-04-26T22:21:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.400+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fda60069530 con 0x7fda6006e410 2024-04-26T22:21:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.400+0000 7fda56a00640 1 -- 172.21.15.16:0/611726480 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fda500f0fa0 con 0x7fda6006e410 2024-04-26T22:21:33.402 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 msgr2=0x7fda3c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 0x7fda3c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda6013d2b0 tx=0x7fda4800b040 comp rx=0 tx=0).stop 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 msgr2=0x7fda6014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda500b2040 tx=0x7fda5001b880 comp rx=0 tx=0).stop 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 shutdown_connections 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fda3c0683b0 0x7fda3c06a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda601465c0 0x7fda60138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda6013eec0 0x7fda6013c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 --2- 172.21.15.16:0/611726480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda6006e410 0x7fda6014ef00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 >> 172.21.15.16:0/611726480 conn(0x7fda600b6590 msgr2=0x7fda6006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 shutdown_connections 2024-04-26T22:21:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.404+0000 7fda64c00640 1 -- 172.21.15.16:0/611726480 wait complete. 2024-04-26T22:21:33.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:33.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.560+0000 7f0ee5200640 1 Processor -- start 2024-04-26T22:21:33.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.560+0000 7f0ee5200640 1 -- start start 2024-04-26T22:21:33.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ee5200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ee5200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ee5200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee00b3f50 con 0x7f0ee00b0ac0 2024-04-26T22:21:33.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ee5200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee00b3310 con 0x7f0ee006e450 2024-04-26T22:21:33.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ee5200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee0070790 con 0x7f0ee00b58d0 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0edde00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:42262/0 (socket says 172.21.15.16:42262) 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 -- 172.21.15.16:0/2622163417 learned_addr learned my addr 172.21.15.16:0/2622163417 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0edde00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58226/0 (socket says 172.21.15.16:58226) 2024-04-26T22:21:33.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 -- 172.21.15.16:0/2622163417 >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 msgr2=0x7f0ee00b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:33.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 --2- 172.21.15.16:0/2622163417 >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 -- 172.21.15.16:0/2622163417 >> v1:172.21.15.195:6789/0 conn(0x7f0ee00b0ac0 legacy=0x7f0ee00b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0ed5400640 1 -- 172.21.15.16:0/2622163417 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee006e830 con 0x7f0ee00b58d0 2024-04-26T22:21:33.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.564+0000 7f0edde00640 1 --2- 172.21.15.16:0/2622163417 >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:33.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ed5400640 1 --2- 172.21.15.16:0/2622163417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009870 tx=0x7f0ec801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cedfd798581c721 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0edd400640 1 -- 172.21.15.16:0/2622163417 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80aa600 con 0x7f0ee00b58d0 2024-04-26T22:21:33.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0edd400640 1 -- 172.21.15.16:0/2622163417 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec80af070 con 0x7f0ee00b58d0 2024-04-26T22:21:33.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0edd400640 1 -- 172.21.15.16:0/2622163417 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec80aa9c0 con 0x7f0ee00b58d0 2024-04-26T22:21:33.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- 172.21.15.16:0/2622163417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 msgr2=0x7f0ee0140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 --2- 172.21.15.16:0/2622163417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009870 tx=0x7f0ec801c4a0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- 172.21.15.16:0/2622163417 shutdown_connections 2024-04-26T22:21:33.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 --2- 172.21.15.16:0/2622163417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b58d0 0x7f0ee0140060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 --2- 172.21.15.16:0/2622163417 >> v2:172.21.15.195:3300/0 conn(0x7f0ee006e450 0x7f0ee00b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- 172.21.15.16:0/2622163417 >> 172.21.15.16:0/2622163417 conn(0x7f0ee00b6620 msgr2=0x7f0ee00b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- 172.21.15.16:0/2622163417 shutdown_connections 2024-04-26T22:21:33.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- 172.21.15.16:0/2622163417 wait complete. 2024-04-26T22:21:33.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 Processor -- start 2024-04-26T22:21:33.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 -- start start 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.568+0000 7f0ee5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b0ac0 0x7f0ee01e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee00b58d0 0x7f0ee01d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0153b70 con 0x7f0ee006e450 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0070420 con 0x7f0ee00b58d0 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee0153cf0 con 0x7f0ee00b0ac0 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42010/0 (socket says 172.21.15.16:42010) 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 -- 172.21.15.16:0/4282642998 learned_addr learned my addr 172.21.15.16:0/4282642998 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ed5400640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b0ac0 0x7f0ee01e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ede800640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee00b58d0 0x7f0ee01d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 -- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b0ac0 msgr2=0x7f0ee01e27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b0ac0 0x7f0ee01e27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 -- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee00b58d0 msgr2=0x7f0ee01d8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee00b58d0 0x7f0ee01d8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 -- 172.21.15.16:0/4282642998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee0074050 con 0x7f0ee006e450 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0edde00640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000ebe0 tx=0x7f0ed000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0017070 con 0x7f0ee006e450 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed000cc30 con 0x7f0ee006e450 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0013470 con 0x7f0ee006e450 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee01376f0 con 0x7f0ee006e450 2024-04-26T22:21:33.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee0073280 con 0x7f0ee006e450 2024-04-26T22:21:33.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee0069530 con 0x7f0ee006e450 2024-04-26T22:21:33.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.572+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ed001a070 con 0x7f0ee006e450 2024-04-26T22:21:33.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.576+0000 7f0ed6a00640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 0x7f0ebc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.576+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0ed0086840 con 0x7f0ee006e450 2024-04-26T22:21:33.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.576+0000 7f0ed5400640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 0x7f0ebc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.576+0000 7f0ed5400640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 0x7f0ebc06a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80ae000 tx=0x7f0ec80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.580+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0ed00567a0 con 0x7f0ee006e450 2024-04-26T22:21:33.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.776+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee013e8a0 con 0x7f0ee006e450 2024-04-26T22:21:33.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.776+0000 7f0ed6a00640 1 -- 172.21.15.16:0/4282642998 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f0ed005aaa0 con 0x7f0ee006e450 2024-04-26T22:21:33.778 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:33.778 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:33.778 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 msgr2=0x7f0ebc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 0x7f0ebc06a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80ae000 tx=0x7f0ec80a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 msgr2=0x7f0ee00b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000ebe0 tx=0x7f0ed000c520 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 shutdown_connections 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0ebc0683b0 0x7f0ebc06a870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee00b58d0 0x7f0ee01d8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0ee00b0ac0 0x7f0ee01e27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 --2- 172.21.15.16:0/4282642998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee006e450 0x7f0ee00b8e20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 >> 172.21.15.16:0/4282642998 conn(0x7f0ee00b6620 msgr2=0x7f0ee013dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 shutdown_connections 2024-04-26T22:21:33.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.780+0000 7f0ee5200640 1 -- 172.21.15.16:0/4282642998 wait complete. 2024-04-26T22:21:33.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:33.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.936+0000 7f7682000640 1 Processor -- start 2024-04-26T22:21:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.936+0000 7f7682000640 1 -- start start 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7682000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f767c0a0bb0 0x7f767c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7682000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c1489c0 0x7f767c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7682000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c0700f0 con 0x7f767c0a07d0 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7682000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f767c070420 con 0x7f767c0a0bb0 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7682000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f767c149330 con 0x7f767c1489c0 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f767c0a0bb0 0x7f767c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f767c0a07d0 0x7f767c073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59544/0 (socket says 172.21.15.16:59544) 2024-04-26T22:21:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767b400640 1 -- 172.21.15.16:0/1978820976 learned_addr learned my addr 172.21.15.16:0/1978820976 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 --2- 172.21.15.16:0/1978820976 >> v2:172.21.15.16:3300/0 conn(0x7f767c0a0bb0 0x7f767c0708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42024/0 (socket says 172.21.15.16:42024) 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767be00640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c1489c0 0x7f767c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 -- 172.21.15.16:0/1978820976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c1489c0 msgr2=0x7f767c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c1489c0 0x7f767c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 -- 172.21.15.16:0/1978820976 >> v1:172.21.15.16:6789/0 conn(0x7f767c0a07d0 legacy=0x7f767c073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 -- 172.21.15.16:0/1978820976 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c071140 con 0x7f767c0a0bb0 2024-04-26T22:21:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f7673e00640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c0a0bb0 0x7f767c0708b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76640097c0 tx=0x7f766401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9cad74d20f1d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767aa00640 1 -- 172.21.15.16:0/1978820976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76640ab430 con 0x7f767c0a0bb0 2024-04-26T22:21:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767aa00640 1 -- 172.21.15.16:0/1978820976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76640b0070 con 0x7f767c0a0bb0 2024-04-26T22:21:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.940+0000 7f767aa00640 1 -- 172.21.15.16:0/1978820976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76640ab7f0 con 0x7f767c0a0bb0 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- 172.21.15.16:0/1978820976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c0a0bb0 msgr2=0x7f767c0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c0a0bb0 0x7f767c0708b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76640097c0 tx=0x7f766401c410 comp rx=0 tx=0).stop 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- 172.21.15.16:0/1978820976 shutdown_connections 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c1489c0 0x7f767c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- 172.21.15.16:0/1978820976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c0a0bb0 0x7f767c0708b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- 172.21.15.16:0/1978820976 >> 172.21.15.16:0/1978820976 conn(0x7f767c0b87c0 msgr2=0x7f767c0b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:33.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- 172.21.15.16:0/1978820976 shutdown_connections 2024-04-26T22:21:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- 172.21.15.16:0/1978820976 wait complete. 2024-04-26T22:21:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 Processor -- start 2024-04-26T22:21:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- start start 2024-04-26T22:21:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f767c0a07d0 0x7f767c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c0a0bb0 0x7f767c1e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f767c155f10 con 0x7f767c1489c0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f767c155d90 con 0x7f767c0a07d0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7682000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f767c156090 con 0x7f767c0a0bb0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42028/0 (socket says 172.21.15.16:42028) 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 -- 172.21.15.16:0/1868212313 learned_addr learned my addr 172.21.15.16:0/1868212313 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767b400640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f767c0a07d0 0x7f767c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f7673e00640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c0a0bb0 0x7f767c1e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 -- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c0a0bb0 msgr2=0x7f767c1e1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c0a0bb0 0x7f767c1e1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 -- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f767c0a07d0 msgr2=0x7f767c147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f767c0a07d0 0x7f767c147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 -- 172.21.15.16:0/1868212313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c143850 con 0x7f767c1489c0 2024-04-26T22:21:33.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.944+0000 7f767be00640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7674007e40 tx=0x7f767400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674014620 con 0x7f767c1489c0 2024-04-26T22:21:33.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674019070 con 0x7f767c1489c0 2024-04-26T22:21:33.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674014a20 con 0x7f767c1489c0 2024-04-26T22:21:33.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c1e1510 con 0x7f767c1489c0 2024-04-26T22:21:33.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c0b5f70 con 0x7f767c1489c0 2024-04-26T22:21:33.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c0b6330 con 0x7f767c1489c0 2024-04-26T22:21:33.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7674014bc0 con 0x7f767c1489c0 2024-04-26T22:21:33.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 0x7f765806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:33.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7674087180 con 0x7f767c1489c0 2024-04-26T22:21:33.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.948+0000 7f767b400640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 0x7f765806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:33.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.952+0000 7f767b400640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 0x7f765806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f70 tx=0x7f766c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:33.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:33.952+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f76740570e0 con 0x7f767c1489c0 2024-04-26T22:21:34.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f767c069530 con 0x7f767c1489c0 2024-04-26T22:21:34.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7673400640 1 -- 172.21.15.16:0/1868212313 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f767405b3e0 con 0x7f767c1489c0 2024-04-26T22:21:34.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:34.121 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:34.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 msgr2=0x7f765806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 0x7f765806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f70 tx=0x7f766c007e90 comp rx=0 tx=0).stop 2024-04-26T22:21:34.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 msgr2=0x7f767c1e1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7674007e40 tx=0x7f767400e4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 shutdown_connections 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7658068380 0x7f765806a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f767c1489c0 0x7f767c1e1f70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f767c0a0bb0 0x7f767c1e1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 --2- 172.21.15.16:0/1868212313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f767c0a07d0 0x7f767c147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 >> 172.21.15.16:0/1868212313 conn(0x7f767c0b87c0 msgr2=0x7f767c073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 shutdown_connections 2024-04-26T22:21:34.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.120+0000 7f7682000640 1 -- 172.21.15.16:0/1868212313 wait complete. 2024-04-26T22:21:34.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:34.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:34.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.284+0000 7fbc64a00640 1 Processor -- start 2024-04-26T22:21:34.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 -- start start 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbc601465c0 0x7fbc600b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbc6013eec0 0x7fbc6013f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6013f850 con 0x7fbc6006e410 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbc60070a40 con 0x7fbc601465c0 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc64a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6006e7f0 con 0x7fbc6013eec0 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbc601465c0 0x7fbc600b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbc601465c0 0x7fbc600b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42042/0 (socket says 172.21.15.16:42042) 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 -- 172.21.15.16:0/3772544726 learned_addr learned my addr 172.21.15.16:0/3772544726 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc5e800640 1 --2- 172.21.15.16:0/3772544726 >> v2:172.21.15.195:3300/0 conn(0x7fbc6013eec0 0x7fbc6013f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 -- 172.21.15.16:0/3772544726 >> v2:172.21.15.195:3300/0 conn(0x7fbc6013eec0 msgr2=0x7fbc6013f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 --2- 172.21.15.16:0/3772544726 >> v2:172.21.15.195:3300/0 conn(0x7fbc6013eec0 0x7fbc6013f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 -- 172.21.15.16:0/3772544726 >> v1:172.21.15.195:6789/0 conn(0x7fbc6006e410 legacy=0x7fbc60149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.288+0000 7fbc57e00640 1 -- 172.21.15.16:0/3772544726 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc60070760 con 0x7fbc601465c0 2024-04-26T22:21:34.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc57e00640 1 --2- 172.21.15.16:0/3772544726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc601465c0 0x7fbc600b30d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b4010 tx=0x7fbc4801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2458c10aec70d51d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc5d400640 1 -- 172.21.15.16:0/3772544726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480b0070 con 0x7fbc601465c0 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc5d400640 1 -- 172.21.15.16:0/3772544726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc480ab600 con 0x7fbc601465c0 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc5d400640 1 -- 172.21.15.16:0/3772544726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480ab9d0 con 0x7fbc601465c0 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- 172.21.15.16:0/3772544726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc601465c0 msgr2=0x7fbc600b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 --2- 172.21.15.16:0/3772544726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc601465c0 0x7fbc600b30d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b4010 tx=0x7fbc4801c450 comp rx=0 tx=0).stop 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- 172.21.15.16:0/3772544726 shutdown_connections 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 --2- 172.21.15.16:0/3772544726 >> v2:172.21.15.195:3300/0 conn(0x7fbc6013eec0 0x7fbc6013f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 --2- 172.21.15.16:0/3772544726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc601465c0 0x7fbc600b30d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- 172.21.15.16:0/3772544726 >> 172.21.15.16:0/3772544726 conn(0x7fbc600b6590 msgr2=0x7fbc600b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- 172.21.15.16:0/3772544726 shutdown_connections 2024-04-26T22:21:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- 172.21.15.16:0/3772544726 wait complete. 2024-04-26T22:21:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 Processor -- start 2024-04-26T22:21:34.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 -- start start 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.292+0000 7fbc64a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 0x7fbc60141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 0x7fbc601e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600b4610 con 0x7fbc6006e410 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600b4490 con 0x7fbc6013eec0 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600b4790 con 0x7fbc601465c0 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42044/0 (socket says 172.21.15.16:42044) 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 -- 172.21.15.16:0/2051916812 learned_addr learned my addr 172.21.15.16:0/2051916812 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:34.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc57e00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 0x7fbc60141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 -- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 msgr2=0x7fbc601e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5e800640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 0x7fbc601e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 0x7fbc601e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 -- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 msgr2=0x7fbc60141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 0x7fbc60141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 -- 172.21.15.16:0/2051916812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc60143730 con 0x7fbc6006e410 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc57e00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 0x7fbc60141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5e800640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 0x7fbc601e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc5de00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c450 tx=0x7fbc5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50012830 con 0x7fbc6006e410 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc50017070 con 0x7fbc6006e410 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50012c30 con 0x7fbc6006e410 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601e0a90 con 0x7fbc6006e410 2024-04-26T22:21:34.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc60142210 con 0x7fbc6006e410 2024-04-26T22:21:34.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60069530 con 0x7fbc6006e410 2024-04-26T22:21:34.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.296+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc5001c460 con 0x7fbc6006e410 2024-04-26T22:21:34.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.300+0000 7fbc56000640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 0x7fbc3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.300+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbc50086730 con 0x7fbc6006e410 2024-04-26T22:21:34.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.300+0000 7fbc57e00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 0x7fbc3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.300+0000 7fbc57e00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 0x7fbc3c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc6006ea30 tx=0x7fbc48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.304+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbc50056ce0 con 0x7fbc6006e410 2024-04-26T22:21:34.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.468+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc6006cad0 con 0x7fbc6006e410 2024-04-26T22:21:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.468+0000 7fbc56000640 1 -- 172.21.15.16:0/2051916812 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fbc500565e0 con 0x7fbc6006e410 2024-04-26T22:21:34.471 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:34.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 msgr2=0x7fbc3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 0x7fbc3c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc6006ea30 tx=0x7fbc48008040 comp rx=0 tx=0).stop 2024-04-26T22:21:34.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 msgr2=0x7fbc60141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c450 tx=0x7fbc5000c910 comp rx=0 tx=0).stop 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 shutdown_connections 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbc3c068380 0x7fbc3c06a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc601465c0 0x7fbc601e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc6013eec0 0x7fbc60141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 --2- 172.21.15.16:0/2051916812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc6006e410 0x7fbc60141790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 >> 172.21.15.16:0/2051916812 conn(0x7fbc600b6590 msgr2=0x7fbc600b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 shutdown_connections 2024-04-26T22:21:34.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.472+0000 7fbc64a00640 1 -- 172.21.15.16:0/2051916812 wait complete. 2024-04-26T22:21:34.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.632+0000 7f7b33400640 1 Processor -- start 2024-04-26T22:21:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 -- start start 2024-04-26T22:21:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b2c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7b2c146bf0 0x7f7b2c140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c070480 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c070a60 con 0x7f7b2c146bf0 2024-04-26T22:21:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b33400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0718a0 con 0x7f7b2c06e410 2024-04-26T22:21:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7b2c0b0a30 0x7f7b2c1464e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40878/0 (socket says 172.21.15.16:40878) 2024-04-26T22:21:34.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2be00640 1 -- 172.21.15.16:0/9624918 learned_addr learned my addr 172.21.15.16:0/9624918 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> v2:172.21.15.195:3300/0 conn(0x7f7b2c146bf0 0x7f7b2c140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b30a00640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b2c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315101660 0 0) 0x7f7b2c070480 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b14003530 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73489904 0 0) 0x7f7b14003530 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 msgr2=0x7f7b2c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b2c13ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 >> v2:172.21.15.195:3300/0 conn(0x7f7b2c146bf0 msgr2=0x7f7b2c140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 --2- 172.21.15.16:0/9624918 >> v2:172.21.15.195:3300/0 conn(0x7f7b2c146bf0 0x7f7b2c140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c06e7f0 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f7b18001680 con 0x7f7b2c0b0a30 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 >> v1:172.21.15.16:6789/0 conn(0x7f7b2c0b0a30 legacy=0x7f7b2c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b140039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b14003f40 0x7f7b14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b14004d50 0x7f7b140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c070a60 con 0x7f7b14004d50 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0718a0 con 0x7f7b14003f40 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1400ba20 con 0x7f7b2c06e410 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> v2:172.21.15.195:3300/0 conn(0x7f7b2c146bf0 0x7f7b2c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b14004d50 0x7f7b140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b30a00640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b140039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b2be00640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b14003f40 0x7f7b14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 -- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 msgr2=0x7f7b140039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b2c06e410 0x7f7b140039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 -- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b14003f40 msgr2=0x7f7b14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b14003f40 0x7f7b14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.636+0000 7f7b31400640 1 -- 172.21.15.16:0/9624918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b14003530 con 0x7f7b14004d50 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b31400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b14004d50 0x7f7b140051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e380 tx=0x7f7b2401caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c74c5f3db4bf53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24009dc0 con 0x7f7b14004d50 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b24003ba0 con 0x7f7b14004d50 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b2b400640 1 -- 172.21.15.16:0/9624918 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24004020 con 0x7f7b14004d50 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 -- 172.21.15.16:0/9624918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b14004d50 msgr2=0x7f7b140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 --2- 172.21.15.16:0/9624918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b14004d50 0x7f7b140051d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e380 tx=0x7f7b2401caf0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b31400640 1 -- 172.21.15.16:0/9624918 reap_dead start 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 -- 172.21.15.16:0/9624918 shutdown_connections 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 -- 172.21.15.16:0/9624918 >> 172.21.15.16:0/9624918 conn(0x7f7b2c0b6590 msgr2=0x7f7b2c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 -- 172.21.15.16:0/9624918 shutdown_connections 2024-04-26T22:21:34.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.640+0000 7f7b33400640 1 -- 172.21.15.16:0/9624918 wait complete. 2024-04-26T22:21:34.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 Processor -- start 2024-04-26T22:21:34.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- start start 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b14004d50 0x7f7b2c1e2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b2c13c820 0x7f7b2c13cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c14b0e0 con 0x7f7b2c147fd0 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c14af60 con 0x7f7b2c13c820 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c14b260 con 0x7f7b14004d50 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41404/0 (socket says 172.21.15.16:41404) 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 -- 172.21.15.16:0/1000819455 learned_addr learned my addr 172.21.15.16:0/1000819455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b30a00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b14004d50 0x7f7b2c1e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b31400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b2c13c820 0x7f7b2c13cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 -- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b14004d50 msgr2=0x7f7b2c1e2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b14004d50 0x7f7b2c1e2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 -- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b2c13c820 msgr2=0x7f7b2c13cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b2c13c820 0x7f7b2c13cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 -- 172.21.15.16:0/1000819455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c148990 con 0x7f7b2c147fd0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b2be00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b180017f0 tx=0x7f7b180129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1801c070 con 0x7f7b2c147fd0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18014810 con 0x7f7b2c147fd0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18014be0 con 0x7f7b2c147fd0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c149c90 con 0x7f7b2c147fd0 2024-04-26T22:21:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c1473c0 con 0x7f7b2c147fd0 2024-04-26T22:21:34.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.644+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c069530 con 0x7f7b2c147fd0 2024-04-26T22:21:34.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.648+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b1801f070 con 0x7f7b2c147fd0 2024-04-26T22:21:34.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.648+0000 7f7b28c00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 0x7f7b0c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.648+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7b18089400 con 0x7f7b2c147fd0 2024-04-26T22:21:34.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.648+0000 7f7b30a00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 0x7f7b0c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.648+0000 7f7b30a00640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 0x7f7b0c06a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009b20 tx=0x7f7b20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.652+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b2c148990 con 0x7f7b2c147fd0 2024-04-26T22:21:34.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b2c147080 con 0x7f7b2c147fd0 2024-04-26T22:21:34.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b28c00640 1 -- 172.21.15.16:0/1000819455 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7b180599b0 con 0x7f7b2c147fd0 2024-04-26T22:21:34.818 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 msgr2=0x7f7b0c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 0x7f7b0c06a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009b20 tx=0x7f7b20008040 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 msgr2=0x7f7b2c148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.816+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b180017f0 tx=0x7f7b180129a0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 shutdown_connections 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7b0c0683b0 0x7f7b0c06a870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b2c13c820 0x7f7b2c13cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b2c147fd0 0x7f7b2c148450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 --2- 172.21.15.16:0/1000819455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7b14004d50 0x7f7b2c1e2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 >> 172.21.15.16:0/1000819455 conn(0x7f7b2c0b6590 msgr2=0x7f7b2c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 shutdown_connections 2024-04-26T22:21:34.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.820+0000 7f7b33400640 1 -- 172.21.15.16:0/1000819455 wait complete. 2024-04-26T22:21:34.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:34.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 Processor -- start 2024-04-26T22:21:34.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 -- start start 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c06e410 0x7fe34c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe34c0b0a30 0x7fe34c140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe34c1464e0 0x7fe34c146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c070a60 con 0x7fe34c1464e0 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c0718a0 con 0x7fe34c0b0a30 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe350a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c070480 con 0x7fe34c06e410 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe34a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe34c1464e0 0x7fe34c146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe34a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe34c1464e0 0x7fe34c146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41418/0 (socket says 172.21.15.16:41418) 2024-04-26T22:21:34.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe34a800640 1 -- 172.21.15.16:0/1158020438 learned_addr learned my addr 172.21.15.16:0/1158020438 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe343e00640 1 --2- 172.21.15.16:0/1158020438 >> v2:172.21.15.195:3300/0 conn(0x7fe34c0b0a30 0x7fe34c140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.979+0000 7fe349e00640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c06e410 0x7fe34c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 -- 172.21.15.16:0/1158020438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c06e410 msgr2=0x7fe34c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c06e410 0x7fe34c13ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 -- 172.21.15.16:0/1158020438 >> v2:172.21.15.195:3300/0 conn(0x7fe34c0b0a30 msgr2=0x7fe34c140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:34.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 --2- 172.21.15.16:0/1158020438 >> v2:172.21.15.195:3300/0 conn(0x7fe34c0b0a30 0x7fe34c140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 -- 172.21.15.16:0/1158020438 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c146e70 con 0x7fe34c1464e0 2024-04-26T22:21:34.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe34a800640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c1464e0 0x7fe34c146930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0b7360 tx=0x7fe34401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a527c2719600ffe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe349400640 1 -- 172.21.15.16:0/1158020438 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a57e0 con 0x7fe34c1464e0 2024-04-26T22:21:34.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe349400640 1 -- 172.21.15.16:0/1158020438 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3440a5980 con 0x7fe34c1464e0 2024-04-26T22:21:34.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe349400640 1 -- 172.21.15.16:0/1158020438 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5d50 con 0x7fe34c1464e0 2024-04-26T22:21:34.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 -- 172.21.15.16:0/1158020438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c1464e0 msgr2=0x7fe34c146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c1464e0 0x7fe34c146930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0b7360 tx=0x7fe34401c960 comp rx=0 tx=0).stop 2024-04-26T22:21:34.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 -- 172.21.15.16:0/1158020438 shutdown_connections 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c1464e0 0x7fe34c146930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 --2- 172.21.15.16:0/1158020438 >> v2:172.21.15.195:3300/0 conn(0x7fe34c0b0a30 0x7fe34c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 --2- 172.21.15.16:0/1158020438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c06e410 0x7fe34c13ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 -- 172.21.15.16:0/1158020438 >> 172.21.15.16:0/1158020438 conn(0x7fe34c0b6590 msgr2=0x7fe34c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 -- 172.21.15.16:0/1158020438 shutdown_connections 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.983+0000 7fe350a00640 1 -- 172.21.15.16:0/1158020438 wait complete. 2024-04-26T22:21:34.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 Processor -- start 2024-04-26T22:21:34.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- start start 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 0x7fe34c1e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c1464e0 0x7fe34c072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0b62e0 con 0x7fe34c0b0a30 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0b6160 con 0x7fe34c06e410 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c14a000 con 0x7fe34c1464e0 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41428/0 (socket says 172.21.15.16:41428) 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 -- 172.21.15.16:0/1352467091 learned_addr learned my addr 172.21.15.16:0/1352467091 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe349e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 0x7fe34c1e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe34a800640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c1464e0 0x7fe34c072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 -- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c1464e0 msgr2=0x7fe34c072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c1464e0 0x7fe34c072eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 -- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 msgr2=0x7fe34c1e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 0x7fe34c1e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 -- 172.21.15.16:0/1352467091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c141d80 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe349e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 0x7fe34c1e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe343e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe33400d800 tx=0x7fe33400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33400b660 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe334019070 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33400ba00 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c0b2bc0 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.987+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c1e4d00 con 0x7fe34c0b0a30 2024-04-26T22:21:34.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c141b00 con 0x7fe34c0b0a30 2024-04-26T22:21:34.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe33400bba0 con 0x7fe34c0b0a30 2024-04-26T22:21:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe342000640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 0x7fe32806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe334086d60 con 0x7fe34c0b0a30 2024-04-26T22:21:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe349e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 0x7fe32806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:34.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.991+0000 7fe349e00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 0x7fe32806a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe33c004660 tx=0x7fe33c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:34.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:34.995+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe34c141b00 con 0x7fe34c0b0a30 2024-04-26T22:21:35.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.159+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe34c069530 con 0x7fe34c0b0a30 2024-04-26T22:21:35.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.159+0000 7fe342000640 1 -- 172.21.15.16:0/1352467091 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fe334057310 con 0x7fe34c0b0a30 2024-04-26T22:21:35.163 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 msgr2=0x7fe32806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 0x7fe32806a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe33c004660 tx=0x7fe33c008040 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 msgr2=0x7fe34c072970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe33400d800 tx=0x7fe33400dcc0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 shutdown_connections 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe3280683b0 0x7fe32806a870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe34c1464e0 0x7fe34c072eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe34c0b0a30 0x7fe34c072970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 --2- 172.21.15.16:0/1352467091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe34c06e410 0x7fe34c1e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 >> 172.21.15.16:0/1352467091 conn(0x7fe34c0b6590 msgr2=0x7fe34c0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 shutdown_connections 2024-04-26T22:21:35.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.163+0000 7fe350a00640 1 -- 172.21.15.16:0/1352467091 wait complete. 2024-04-26T22:21:35.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:35.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 Processor -- start 2024-04-26T22:21:35.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 -- start start 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddbc0b8680 0x7fddbc146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fddbc073d90 0x7fddbc140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0b8dd0 con 0x7fddbc0b66c0 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0b6b80 con 0x7fddbc0b8680 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddc2800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc14a210 con 0x7fddbc073d90 2024-04-26T22:21:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddbc0b8680 0x7fddbc146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbbe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fddbc0b66c0 0x7fddbc072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40886/0 (socket says 172.21.15.16:40886) 2024-04-26T22:21:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbbe00640 1 -- 172.21.15.16:0/3219413359 learned_addr learned my addr 172.21.15.16:0/3219413359 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddb3e00640 1 --2- 172.21.15.16:0/3219413359 >> v2:172.21.15.195:3300/0 conn(0x7fddbc073d90 0x7fddbc140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbb400640 1 -- 172.21.15.16:0/3219413359 >> v2:172.21.15.195:3300/0 conn(0x7fddbc073d90 msgr2=0x7fddbc140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbb400640 1 --2- 172.21.15.16:0/3219413359 >> v2:172.21.15.195:3300/0 conn(0x7fddbc073d90 0x7fddbc140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbb400640 1 -- 172.21.15.16:0/3219413359 >> v1:172.21.15.16:6789/0 conn(0x7fddbc0b66c0 legacy=0x7fddbc072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbb400640 1 -- 172.21.15.16:0/3219413359 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc149ea0 con 0x7fddbc0b8680 2024-04-26T22:21:35.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.323+0000 7fddbaa00640 1 -- 172.21.15.16:0/3219413359 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735202571 0 0) 0x7fddbc0b8dd0 con 0x7fddbc0b66c0 2024-04-26T22:21:35.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddbb400640 1 --2- 172.21.15.16:0/3219413359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b8680 0x7fddbc146380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddbc14a390 tx=0x7fddac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a2da0f74ac65af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddbaa00640 1 -- 172.21.15.16:0/3219413359 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0b0070 con 0x7fddbc0b8680 2024-04-26T22:21:35.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddbaa00640 1 -- 172.21.15.16:0/3219413359 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddac0ab600 con 0x7fddbc0b8680 2024-04-26T22:21:35.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddbaa00640 1 -- 172.21.15.16:0/3219413359 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac0ab9d0 con 0x7fddbc0b8680 2024-04-26T22:21:35.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- 172.21.15.16:0/3219413359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b8680 msgr2=0x7fddbc146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 --2- 172.21.15.16:0/3219413359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b8680 0x7fddbc146380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddbc14a390 tx=0x7fddac01c3d0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- 172.21.15.16:0/3219413359 shutdown_connections 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 --2- 172.21.15.16:0/3219413359 >> v2:172.21.15.195:3300/0 conn(0x7fddbc073d90 0x7fddbc140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 --2- 172.21.15.16:0/3219413359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b8680 0x7fddbc146380 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- 172.21.15.16:0/3219413359 >> 172.21.15.16:0/3219413359 conn(0x7fddbc06f3d0 msgr2=0x7fddbc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- 172.21.15.16:0/3219413359 shutdown_connections 2024-04-26T22:21:35.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- 172.21.15.16:0/3219413359 wait complete. 2024-04-26T22:21:35.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 Processor -- start 2024-04-26T22:21:35.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.327+0000 7fddc2800640 1 -- start start 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddbc073d90 0x7fddbc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0b8680 0x7fddbc1e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc14a6a0 con 0x7fddbc0b66c0 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc1468c0 con 0x7fddbc0b8680 2024-04-26T22:21:35.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc141dd0 con 0x7fddbc073d90 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41436/0 (socket says 172.21.15.16:41436) 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 -- 172.21.15.16:0/2875320207 learned_addr learned my addr 172.21.15.16:0/2875320207 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddbb400640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddbc073d90 0x7fddbc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddbbe00640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0b8680 0x7fddbc1e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 -- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddbc073d90 msgr2=0x7fddbc138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddbc073d90 0x7fddbc138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 -- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0b8680 msgr2=0x7fddbc1e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0b8680 0x7fddbc1e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 -- 172.21.15.16:0/2875320207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc0b2330 con 0x7fddbc0b66c0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3e00640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdda400e960 tx=0x7fdda400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4017070 con 0x7fddbc0b66c0 2024-04-26T22:21:35.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda400ca00 con 0x7fddbc0b66c0 2024-04-26T22:21:35.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda400cdb0 con 0x7fddbc0b66c0 2024-04-26T22:21:35.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc142d40 con 0x7fddbc0b66c0 2024-04-26T22:21:35.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc1397c0 con 0x7fddbc0b66c0 2024-04-26T22:21:35.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc142f10 con 0x7fddbc0b66c0 2024-04-26T22:21:35.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.331+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdda401a070 con 0x7fddbc0b66c0 2024-04-26T22:21:35.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.335+0000 7fddb3400640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.335+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdda4086930 con 0x7fddbc0b66c0 2024-04-26T22:21:35.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.335+0000 7fddbb400640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.335+0000 7fddbb400640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fddac0ad000 tx=0x7fddac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.339+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdda4056f80 con 0x7fddbc0b66c0 2024-04-26T22:21:35.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddbc069530 con 0x7fddbc0b66c0 2024-04-26T22:21:35.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddb3400640 1 -- 172.21.15.16:0/2875320207 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fdda4056880 con 0x7fddbc0b66c0 2024-04-26T22:21:35.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:35.541 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:35.542 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 msgr2=0x7fdd9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fddac0ad000 tx=0x7fddac008040 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 msgr2=0x7fddbc139280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdda400e960 tx=0x7fdda400ee20 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 shutdown_connections 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fddbc0b8680 0x7fddbc1e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddbc0b66c0 0x7fddbc139280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 --2- 172.21.15.16:0/2875320207 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fddbc073d90 0x7fddbc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 >> 172.21.15.16:0/2875320207 conn(0x7fddbc06f3d0 msgr2=0x7fddbc0badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:35.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 shutdown_connections 2024-04-26T22:21:35.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.539+0000 7fddc2800640 1 -- 172.21.15.16:0/2875320207 wait complete. 2024-04-26T22:21:35.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:35.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.699+0000 7fbeea600640 1 Processor -- start 2024-04-26T22:21:35.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.699+0000 7fbeea600640 1 -- start start 2024-04-26T22:21:35.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbeea600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbee40b88e0 0x7fbee40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbeea600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee4146240 0x7fbee40b7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbeea600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee40b8cc0 con 0x7fbee40b53b0 2024-04-26T22:21:35.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbeea600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbee40b6ef0 con 0x7fbee40b88e0 2024-04-26T22:21:35.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbeea600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbee40b7470 con 0x7fbee4146240 2024-04-26T22:21:35.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbee40b88e0 0x7fbee40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbee40b53b0 0x7fbee41497b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40896/0 (socket says 172.21.15.16:40896) 2024-04-26T22:21:35.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9c00640 1 -- 172.21.15.16:0/239825880 learned_addr learned my addr 172.21.15.16:0/239825880 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:35.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee3e00640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee4146240 0x7fbee40b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9200640 1 -- 172.21.15.16:0/239825880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee4146240 msgr2=0x7fbee40b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:35.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9200640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee4146240 0x7fbee40b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9200640 1 -- 172.21.15.16:0/239825880 >> v1:172.21.15.16:6789/0 conn(0x7fbee40b53b0 legacy=0x7fbee41497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee9200640 1 -- 172.21.15.16:0/239825880 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee40b6c10 con 0x7fbee40b88e0 2024-04-26T22:21:35.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.703+0000 7fbee3400640 1 -- 172.21.15.16:0/239825880 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614990144 0 0) 0x7fbee40b8cc0 con 0x7fbee40b53b0 2024-04-26T22:21:35.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee9200640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee40b65f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097c0 tx=0x7fbed801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741afa215dcd3186 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3400640 1 -- 172.21.15.16:0/239825880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80b0070 con 0x7fbee40b88e0 2024-04-26T22:21:35.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3400640 1 -- 172.21.15.16:0/239825880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed80ab600 con 0x7fbee40b88e0 2024-04-26T22:21:35.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3400640 1 -- 172.21.15.16:0/239825880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80ab9d0 con 0x7fbee40b88e0 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- 172.21.15.16:0/239825880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 msgr2=0x7fbee40b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee40b65f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097c0 tx=0x7fbed801c380 comp rx=0 tx=0).stop 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- 172.21.15.16:0/239825880 shutdown_connections 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee4146240 0x7fbee40b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- 172.21.15.16:0/239825880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee40b65f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- 172.21.15.16:0/239825880 >> 172.21.15.16:0/239825880 conn(0x7fbee406f500 msgr2=0x7fbee406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- 172.21.15.16:0/239825880 shutdown_connections 2024-04-26T22:21:35.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- 172.21.15.16:0/239825880 wait complete. 2024-04-26T22:21:35.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 Processor -- start 2024-04-26T22:21:35.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- start start 2024-04-26T22:21:35.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee40b53b0 0x7fbee4138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 0x7fbee41e2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4153b00 con 0x7fbee40b88e0 2024-04-26T22:21:35.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbee4073ee0 con 0x7fbee413f840 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbeea600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbee4153c80 con 0x7fbee40b53b0 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41440/0 (socket says 172.21.15.16:41440) 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee3e00640 1 -- 172.21.15.16:0/1084990758 learned_addr learned my addr 172.21.15.16:0/1084990758 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee9200640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee40b53b0 0x7fbee4138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.707+0000 7fbee9c00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 0x7fbee41e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 -- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee40b53b0 msgr2=0x7fbee4138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee40b53b0 0x7fbee4138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 -- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 msgr2=0x7fbee41e2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 0x7fbee41e2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 -- 172.21.15.16:0/1084990758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee413ab50 con 0x7fbee40b88e0 2024-04-26T22:21:35.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee9c00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 0x7fbee41e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee3e00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbed000d830 tx=0x7fbed000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed000b6c0 con 0x7fbee40b88e0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0019070 con 0x7fbee40b88e0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed000ba60 con 0x7fbee40b88e0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee4139e90 con 0x7fbee40b88e0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee413adf0 con 0x7fbee40b88e0 2024-04-26T22:21:35.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee413fc50 con 0x7fbee40b88e0 2024-04-26T22:21:35.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.711+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbed001e460 con 0x7fbee40b88e0 2024-04-26T22:21:35.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.715+0000 7fbee0c00640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 0x7fbec406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:35.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.715+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbed0086fe0 con 0x7fbee40b88e0 2024-04-26T22:21:35.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.715+0000 7fbee9200640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 0x7fbec406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:35.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.715+0000 7fbee9200640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 0x7fbec406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:35.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.719+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbed00575b0 con 0x7fbee40b88e0 2024-04-26T22:21:35.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.883+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbee40507b0 con 0x7fbee40b88e0 2024-04-26T22:21:35.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.883+0000 7fbee0c00640 1 -- 172.21.15.16:0/1084990758 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fbed0056eb0 con 0x7fbee40b88e0 2024-04-26T22:21:35.887 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:35.887 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:35.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 msgr2=0x7fbec406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 0x7fbec406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbed80ad000 tx=0x7fbed8008040 comp rx=0 tx=0).stop 2024-04-26T22:21:35.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 msgr2=0x7fbee4148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:35.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbed000d830 tx=0x7fbed000dcf0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 shutdown_connections 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbec4068380 0x7fbec406a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbee413f840 0x7fbee41e2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbee40b88e0 0x7fbee4148fe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 --2- 172.21.15.16:0/1084990758 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbee40b53b0 0x7fbee4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 >> 172.21.15.16:0/1084990758 conn(0x7fbee406f500 msgr2=0x7fbee40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 shutdown_connections 2024-04-26T22:21:35.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:35.887+0000 7fbeea600640 1 -- 172.21.15.16:0/1084990758 wait complete. 2024-04-26T22:21:35.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:36.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 Processor -- start 2024-04-26T22:21:36.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 -- start start 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4f340b1020 0x7f4f340b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f340b61c0 con 0x7f4f34149ba0 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340b2780 con 0x7f4f340b1020 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f38e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4f340b16a0 con 0x7f4f3406e450 2024-04-26T22:21:36.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4f340b1020 0x7f4f340b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:34436/0 (socket says 172.21.15.16:34436) 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f32800640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f4f34149ba0 0x7f4f3414fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:55320/0 (socket says 172.21.15.16:55320) 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 -- 172.21.15.16:0/2492985901 learned_addr learned my addr 172.21.15.16:0/2492985901 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 -- 172.21.15.16:0/2492985901 >> v2:172.21.15.195:3300/0 conn(0x7f4f340b1020 msgr2=0x7f4f340b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 --2- 172.21.15.16:0/2492985901 >> v2:172.21.15.195:3300/0 conn(0x7f4f340b1020 0x7f4f340b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 -- 172.21.15.16:0/2492985901 >> v1:172.21.15.195:6789/0 conn(0x7f4f34149ba0 legacy=0x7f4f3414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f31e00640 1 -- 172.21.15.16:0/2492985901 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3406e830 con 0x7f4f3406e450 2024-04-26T22:21:36.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.047+0000 7f4f30a00640 1 -- 172.21.15.16:0/2492985901 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735050525 0 0) 0x7f4f340b61c0 con 0x7f4f34149ba0 2024-04-26T22:21:36.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f31e00640 1 --2- 172.21.15.16:0/2492985901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009870 tx=0x7f4f2401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f425ae65ddfad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f30a00640 1 -- 172.21.15.16:0/2492985901 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240b0070 con 0x7f4f3406e450 2024-04-26T22:21:36.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f30a00640 1 -- 172.21.15.16:0/2492985901 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f240ab600 con 0x7f4f3406e450 2024-04-26T22:21:36.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f30a00640 1 -- 172.21.15.16:0/2492985901 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240ab9d0 con 0x7f4f3406e450 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 -- 172.21.15.16:0/2492985901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 msgr2=0x7f4f340b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 --2- 172.21.15.16:0/2492985901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009870 tx=0x7f4f2401c4d0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 -- 172.21.15.16:0/2492985901 shutdown_connections 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 --2- 172.21.15.16:0/2492985901 >> v2:172.21.15.195:3300/0 conn(0x7f4f340b1020 0x7f4f340b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 --2- 172.21.15.16:0/2492985901 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f3406e450 0x7f4f340b1b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 -- 172.21.15.16:0/2492985901 >> 172.21.15.16:0/2492985901 conn(0x7f4f340b6620 msgr2=0x7f4f340b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 -- 172.21.15.16:0/2492985901 shutdown_connections 2024-04-26T22:21:36.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 -- 172.21.15.16:0/2492985901 wait complete. 2024-04-26T22:21:36.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.051+0000 7f4f38e00640 1 Processor -- start 2024-04-26T22:21:36.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- start start 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f340b1020 0x7f4f34147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f34149ba0 0x7f4f341e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3415a300 con 0x7f4f3406e450 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3415a180 con 0x7f4f34149ba0 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4f3415a480 con 0x7f4f340b1020 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41442/0 (socket says 172.21.15.16:41442) 2024-04-26T22:21:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 -- 172.21.15.16:0/4132867218 learned_addr learned my addr 172.21.15.16:0/4132867218 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f32800640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f34149ba0 0x7f4f341e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31400640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f340b1020 0x7f4f34147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 -- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f340b1020 msgr2=0x7f4f34147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f340b1020 0x7f4f34147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 -- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f34149ba0 msgr2=0x7f4f341e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f34149ba0 0x7f4f341e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 -- 172.21.15.16:0/4132867218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f34144b80 con 0x7f4f3406e450 2024-04-26T22:21:36.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f31e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f240ae040 tx=0x7f4f2401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240b0040 con 0x7f4f3406e450 2024-04-26T22:21:36.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f240bc070 con 0x7f4f3406e450 2024-04-26T22:21:36.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f34070db0 con 0x7f4f3406e450 2024-04-26T22:21:36.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240b6640 con 0x7f4f3406e450 2024-04-26T22:21:36.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f34145c10 con 0x7f4f3406e450 2024-04-26T22:21:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f34069530 con 0x7f4f3406e450 2024-04-26T22:21:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.055+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f240b67e0 con 0x7f4f3406e450 2024-04-26T22:21:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.059+0000 7f4f2a000640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 0x7f4f1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.059+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4f24120db0 con 0x7f4f3406e450 2024-04-26T22:21:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.059+0000 7f4f31400640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 0x7f4f1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.059+0000 7f4f31400640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 0x7f4f1406a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f34149820 tx=0x7f4f20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.063+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f24125070 con 0x7f4f3406e450 2024-04-26T22:21:36.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.259+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f34157f50 con 0x7f4f3406e450 2024-04-26T22:21:36.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.259+0000 7f4f2a000640 1 -- 172.21.15.16:0/4132867218 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f4f24016150 con 0x7f4f3406e450 2024-04-26T22:21:36.263 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:36.263 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:36.263 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:36.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 msgr2=0x7f4f1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 0x7f4f1406a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4f34149820 tx=0x7f4f20008040 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 msgr2=0x7f4f34144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f240ae040 tx=0x7f4f2401ad10 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 shutdown_connections 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4f14068380 0x7f4f1406a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f34149ba0 0x7f4f341e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4f340b1020 0x7f4f34147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 --2- 172.21.15.16:0/4132867218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f3406e450 0x7f4f34144410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 >> 172.21.15.16:0/4132867218 conn(0x7f4f340b6620 msgr2=0x7f4f3414c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 shutdown_connections 2024-04-26T22:21:36.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.263+0000 7f4f38e00640 1 -- 172.21.15.16:0/4132867218 wait complete. 2024-04-26T22:21:36.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:21:21.782581+0000', 'modified': '2024-04-26T22:21:24.807268+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/3737019870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 3737019870}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 3737019870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4266, 'qdb_cluster': [4266]} 2024-04-26T22:21:36.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:21:36.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:21:36.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 Processor -- start 2024-04-26T22:21:36.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 -- start start 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0980b7790 0x7fb09814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb098145d10 0x7fb098148c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb098146140 con 0x7fb098148820 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb0980aeaa0 con 0x7fb098145d10 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb09e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb0981491c0 con 0x7fb0980b7790 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb08ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb098148820 0x7fb098145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40908/0 (socket says 172.21.15.16:40908) 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb08ea00640 1 -- 172.21.15.16:0/523185044 learned_addr learned my addr 172.21.15.16:0/523185044 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097e00640 1 --2- 172.21.15.16:0/523185044 >> v2:172.21.15.16:3300/0 conn(0x7fb098145d10 0x7fb098148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097400640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0980b7790 0x7fb09814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb096a00640 1 -- 172.21.15.16:0/523185044 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953289377 0 0) 0x7fb098146140 con 0x7fb098148820 2024-04-26T22:21:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097e00640 1 -- 172.21.15.16:0/523185044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0980b7790 msgr2=0x7fb09814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097e00640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0980b7790 0x7fb09814bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097e00640 1 -- 172.21.15.16:0/523185044 >> v1:172.21.15.16:6789/0 conn(0x7fb098148820 legacy=0x7fb098145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.627+0000 7fb097e00640 1 -- 172.21.15.16:0/523185044 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0980b7b70 con 0x7fb098145d10 2024-04-26T22:21:36.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb097e00640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb098145d10 0x7fb098148c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb090009dc0 tx=0x7fb09001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a586572d979d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb096a00640 1 -- 172.21.15.16:0/523185044 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900b2070 con 0x7fb098145d10 2024-04-26T22:21:36.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb096a00640 1 -- 172.21.15.16:0/523185044 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900a5950 con 0x7fb098145d10 2024-04-26T22:21:36.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb096a00640 1 -- 172.21.15.16:0/523185044 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5d20 con 0x7fb098145d10 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- 172.21.15.16:0/523185044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb098145d10 msgr2=0x7fb098148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb098145d10 0x7fb098148c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb090009dc0 tx=0x7fb09001c890 comp rx=0 tx=0).stop 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- 172.21.15.16:0/523185044 shutdown_connections 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb098145d10 0x7fb098148c80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 --2- 172.21.15.16:0/523185044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0980b7790 0x7fb09814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- 172.21.15.16:0/523185044 >> 172.21.15.16:0/523185044 conn(0x7fb09806cbc0 msgr2=0x7fb0980b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- 172.21.15.16:0/523185044 shutdown_connections 2024-04-26T22:21:36.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- 172.21.15.16:0/523185044 wait complete. 2024-04-26T22:21:36.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 Processor -- start 2024-04-26T22:21:36.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.631+0000 7fb09e400640 1 -- start start 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 0x7fb0981e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 0x7fb0981e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0980ba0e0 con 0x7fb0980b7790 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb0980b9f60 con 0x7fb098148820 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb098155770 con 0x7fb098145d10 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41460/0 (socket says 172.21.15.16:41460) 2024-04-26T22:21:36.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 -- 172.21.15.16:0/2492730572 learned_addr learned my addr 172.21.15.16:0/2492730572 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 0x7fb0981e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097e00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 0x7fb0981e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 -- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 msgr2=0x7fb0981e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 0x7fb0981e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 -- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 msgr2=0x7fb0981e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 0x7fb0981e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 -- 172.21.15.16:0/2492730572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0980b2340 con 0x7fb0980b7790 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 0x7fb0981e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097e00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 0x7fb0981e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb097400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e930 tx=0x7fb08000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08fe00640 1 -- 172.21.15.16:0/2492730572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080017070 con 0x7fb0980b7790 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08fe00640 1 -- 172.21.15.16:0/2492730572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08000ca00 con 0x7fb0980b7790 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08fe00640 1 -- 172.21.15.16:0/2492730572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08000cdb0 con 0x7fb0980b7790 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0980b2620 con 0x7fb0980b7790 2024-04-26T22:21:36.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb098144510 con 0x7fb0980b7790 2024-04-26T22:21:36.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.635+0000 7fb08fe00640 1 -- 172.21.15.16:0/2492730572 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb08001a070 con 0x7fb0980b7790 2024-04-26T22:21:36.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08fe00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08fe00640 1 -- 172.21.15.16:0/2492730572 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb080086a00 con 0x7fb0980b7790 2024-04-26T22:21:36.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 Processor -- start 2024-04-26T22:21:36.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- start start 2024-04-26T22:21:36.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb088007fd0 tx=0x7fb088009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x564475933770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x56447595e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x5644757e6140 con 0x56447595d4f0 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56447577be00 con 0x56447595ff80 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564475734a00 con 0x56447595de10 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41472/0 (socket says 172.21.15.16:41472) 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 -- 172.21.15.16:0/2965695433 learned_addr learned my addr 172.21.15.16:0/2965695433 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb097400640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x564475933770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb097e00640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x56447595e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 -- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 msgr2=0x56447595e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x56447595e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 -- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 msgr2=0x564475933770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x564475933770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 -- 172.21.15.16:0/2965695433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644757390e0 con 0x56447595d4f0 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb097e00640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x56447595e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:36.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0880073f0 tx=0x7fb088010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa308c8689f42e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb087e00640 1 -- 172.21.15.16:0/2965695433 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08800dbb0 con 0x56447595d4f0 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb087e00640 1 -- 172.21.15.16:0/2965695433 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08800dd70 con 0x56447595d4f0 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb087e00640 1 -- 172.21.15.16:0/2965695433 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088020690 con 0x56447595d4f0 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- 172.21.15.16:0/2965695433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 msgr2=0x56447595d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb0880073f0 tx=0x7fb088010000 comp rx=0 tx=0).stop 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- 172.21.15.16:0/2965695433 shutdown_connections 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x56447595e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x56447595d8d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2965695433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x564475933770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- 172.21.15.16:0/2965695433 >> 172.21.15.16:0/2965695433 conn(0x564475925150 msgr2=0x564475934820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- 172.21.15.16:0/2965695433 shutdown_connections 2024-04-26T22:21:36.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.639+0000 7fb0a1800000 1 -- 172.21.15.16:0/2965695433 wait complete. 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- start start 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 Processor -- start 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595de10 0x564475932170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595ff80 0x5644759326b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564475789200 con 0x56447595d4f0 2024-04-26T22:21:36.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56447571fe80 con 0x56447595de10 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x564475776ae0 con 0x56447595ff80 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 10 client.0 _ll_register_callbacks cb 0x564475788da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41484/0 (socket says 172.21.15.16:41484) 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 -- 172.21.15.16:0/4117773290 learned_addr learned my addr 172.21.15.16:0/4117773290 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 -- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595ff80 msgr2=0x5644759326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595ff80 0x5644759326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 -- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595de10 msgr2=0x564475932170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595de10 0x564475932170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 -- 172.21.15.16:0/4117773290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56447571b4e0 con 0x56447595d4f0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb097400640 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0800097c0 tx=0x7fb08005ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5640c866157ddc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080082020 con 0x56447595d4f0 2024-04-26T22:21:36.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb080055dc0 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08800dd70 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb080021070 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 10 client.4629 fetch_fsmap learned FSMap version 8 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564475701e80 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08800dd70 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7fb080086040 con 0x56447595d4f0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 10 client.4629 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 20 client.4629 populate_metadata read hostname 'smithi016' 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759330c0 0x564475974b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 4 client.4629 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 --> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564475714bc0 con 0x5644759330c0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb08ea00640 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759330c0 0x564475974b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb08ea00640 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759330c0 0x564475974b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c92e5003da584a5c server_cookie=2cf77b98a3c97501 in_seq=0 out_seq=0 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.643+0000 7fb084c00640 10 client.4629 ms_handle_connect on v2:172.21.15.16:6832/3737019870 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb084c00640 1 -- 172.21.15.16:0/4117773290 <== mds.0 v2:172.21.15.16:6832/3737019870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564475714bc0 con 0x5644759330c0 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb084c00640 10 client.4629 handle_command_reply: tid=0 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 client.4629 shutdown 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 msgr2=0x564475931c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0800097c0 tx=0x7fb08005ad20 comp rx=0 tx=0).stop 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 shutdown_connections 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759330c0 0x564475974b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595ff80 0x5644759326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595de10 0x564475932170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb084c00640 0 client.4629 ms_handle_reset on v2:172.21.15.16:6832/3737019870 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 --2- 172.21.15.16:0/4117773290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x564475931c30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 >> 172.21.15.16:0/4117773290 conn(0x564475925150 msgr2=0x56447595ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 shutdown_connections 2024-04-26T22:21:36.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 1 -- 172.21.15.16:0/4117773290 wait complete. 2024-04-26T22:21:36.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.647+0000 7fb0a1800000 20 client.4629 trim_cache size 0 max 16384 2024-04-26T22:21:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 Processor -- start 2024-04-26T22:21:36.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 -- start start 2024-04-26T22:21:36.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 0x5644759cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0981ed2d0 con 0x56447595ff80 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb0981423e0 con 0x56447595d4f0 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5644757117b0 con 0x56447595de10 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.663+0000 7fb097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41498/0 (socket says 172.21.15.16:41498) 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 -- 172.21.15.16:0/2683787684 learned_addr learned my addr 172.21.15.16:0/2683787684 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 0x5644759cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb08ea00640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 -- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 msgr2=0x5644759d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 -- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 msgr2=0x5644759cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 0x5644759cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 -- 172.21.15.16:0/2683787684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564475734c50 con 0x56447595ff80 2024-04-26T22:21:36.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 0x5644759cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb09001af40 tx=0x7fb090004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620c34c696b619f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb087400640 1 -- 172.21.15.16:0/2683787684 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900b2040 con 0x56447595ff80 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb087400640 1 -- 172.21.15.16:0/2683787684 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900a5a10 con 0x56447595ff80 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb087400640 1 -- 172.21.15.16:0/2683787684 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5e00 con 0x56447595ff80 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- 172.21.15.16:0/2683787684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 msgr2=0x5644759d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb09001af40 tx=0x7fb090004a50 comp rx=0 tx=0).stop 2024-04-26T22:21:36.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- 172.21.15.16:0/2683787684 shutdown_connections 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595ff80 0x5644759d34b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- 172.21.15.16:0/2683787684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595d4f0 0x5644759cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- 172.21.15.16:0/2683787684 >> 172.21.15.16:0/2683787684 conn(0x564475925150 msgr2=0x56447595f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- 172.21.15.16:0/2683787684 shutdown_connections 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- 172.21.15.16:0/2683787684 wait complete. 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- start start 2024-04-26T22:21:36.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 Processor -- start 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x5644759d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x564475780430 con 0x56447595d4f0 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x56447577b110 con 0x56447595ff80 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x5644757880a0 con 0x56447595de10 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb0a1800000 10 client.0 _ll_register_callbacks cb 0x7fb08000cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41512/0 (socket says 172.21.15.16:41512) 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 -- 172.21.15.16:0/869872743 learned_addr learned my addr 172.21.15.16:0/869872743 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097e00640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x5644759d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb08ea00640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 -- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 msgr2=0x5644759cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 -- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 msgr2=0x5644759d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x5644759d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb097400640 1 -- 172.21.15.16:0/869872743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644757fe160 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.667+0000 7fb08ea00640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb097400640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb080056670 tx=0x7fb080084df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d6e8261eeb3612 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080082070 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb08005d0b0 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0900a5a10 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fb08004a050 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 10 client.4635 fetch_fsmap learned FSMap version 8 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5644754350c0 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900a5a10 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7fb08004d020 con 0x56447595d4f0 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T22:21:36.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 20 client.4635 populate_metadata read hostname 'smithi016' 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759d08b0 0x5644759d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 4 client.4635 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 --> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] -- command(tid 0: {"prefix": "status"}) -- 0x564475789a10 con 0x5644759d08b0 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb08ea00640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759d08b0 0x5644759d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 10 client.4635 ms_handle_connect on v2:172.21.15.16:6832/3737019870 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb08ea00640 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759d08b0 0x5644759d0c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1695ab2e9ddc9fc2 server_cookie=71878a592cfb456c in_seq=0 out_seq=0 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 1 -- 172.21.15.16:0/869872743 <== mds.0 v2:172.21.15.16:6832/3737019870 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x564475789a10 con 0x5644759d08b0 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 10 client.4635 handle_command_reply: tid=0 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 client.4635 shutdown 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 msgr2=0x5644759cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb080056670 tx=0x7fb080084df0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 shutdown_connections 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:6832/3737019870,v1:172.21.15.16:6833/3737019870] conn(0x5644759d08b0 0x5644759d0c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56447595ff80 0x5644759d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x56447595de10 0x5644759cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb084c00640 0 client.4635 ms_handle_reset on v2:172.21.15.16:6832/3737019870 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 --2- 172.21.15.16:0/869872743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x56447595d4f0 0x5644759cf3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 >> 172.21.15.16:0/869872743 conn(0x564475925150 msgr2=0x564475974b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 shutdown_connections 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 1 -- 172.21.15.16:0/869872743 wait complete. 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb0a1800000 20 client.4635 trim_cache size 0 max 16384 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "53f352df-dd5a-41be-a68c-8728a38a6452", 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-26T22:21:36.678 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4266, 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 14.272937821999999, 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 8, 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 22, 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 22, 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 21.330977146999999 2024-04-26T22:21:36.679 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 msgr2=0x7fb07406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb088007fd0 tx=0x7fb088009040 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 msgr2=0x7fb09813fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e930 tx=0x7fb08000edf0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 shutdown_connections 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb098148820 0x7fb0981e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb098145d10 0x7fb0981e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 --2- 172.21.15.16:0/2492730572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0980b7790 0x7fb09813fa80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 >> 172.21.15.16:0/2492730572 conn(0x7fb09806cbc0 msgr2=0x7fb098147b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 shutdown_connections 2024-04-26T22:21:36.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.671+0000 7fb09e400640 1 -- 172.21.15.16:0/2492730572 wait complete. 2024-04-26T22:21:36.694 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T22:21:36.703 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T22:21:36.703 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T22:21:36.703 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T22:21:36.703 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T22:21:36.734 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T22:21:36.734 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T22:21:36.734 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T22:21:36.735 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T22:21:36.735 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:36.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:36.735 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T22:21:36.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:36.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-26T22:21:36.809 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-04-26T22:21:36.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:21:36.811 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T22:21:36.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:21:36.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.991+0000 7f66bac00640 1 Processor -- start 2024-04-26T22:21:36.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.991+0000 7f66bac00640 1 -- start start 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66bac00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66b40a07d0 0x7f66b4073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66bac00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f66b41489c0 0x7f66b4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66bac00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66b40700f0 con 0x7f66b40a0bb0 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66bac00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f66b4070420 con 0x7f66b40a07d0 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66bac00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f66b4149330 con 0x7f66b41489c0 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66b40a07d0 0x7f66b4073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66b40a07d0 0x7f66b4073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41520/0 (socket says 172.21.15.16:41520) 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 -- 172.21.15.16:0/521584627 learned_addr learned my addr 172.21.15.16:0/521584627 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:36.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b8c00640 1 --2- 172.21.15.16:0/521584627 >> v2:172.21.15.195:3300/0 conn(0x7f66b41489c0 0x7f66b4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:36.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 -- 172.21.15.16:0/521584627 >> v2:172.21.15.195:3300/0 conn(0x7f66b41489c0 msgr2=0x7f66b4152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:36.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 --2- 172.21.15.16:0/521584627 >> v2:172.21.15.195:3300/0 conn(0x7f66b41489c0 0x7f66b4152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:36.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 -- 172.21.15.16:0/521584627 >> v1:172.21.15.195:6789/0 conn(0x7f66b40a0bb0 legacy=0x7f66b40708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:36.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.995+0000 7f66b3e00640 1 -- 172.21.15.16:0/521584627 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4071140 con 0x7f66b40a07d0 2024-04-26T22:21:37.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b3e00640 1 --2- 172.21.15.16:0/521584627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b40a07d0 0x7f66b4073640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66b41484a0 tx=0x7f66a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4655ae5a2d310c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:37.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b3400640 1 -- 172.21.15.16:0/521584627 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a40b1070 con 0x7f66b40a07d0 2024-04-26T22:21:37.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b3400640 1 -- 172.21.15.16:0/521584627 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a40ac600 con 0x7f66b40a07d0 2024-04-26T22:21:37.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b3400640 1 -- 172.21.15.16:0/521584627 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a40ac9d0 con 0x7f66b40a07d0 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- 172.21.15.16:0/521584627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b40a07d0 msgr2=0x7f66b4073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- 172.21.15.16:0/521584627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b40a07d0 0x7f66b4073640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f66b41484a0 tx=0x7f66a401c490 comp rx=0 tx=0).stop 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- 172.21.15.16:0/521584627 shutdown_connections 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- 172.21.15.16:0/521584627 >> v2:172.21.15.195:3300/0 conn(0x7f66b41489c0 0x7f66b4152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- 172.21.15.16:0/521584627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b40a07d0 0x7f66b4073640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- 172.21.15.16:0/521584627 >> 172.21.15.16:0/521584627 conn(0x7f66b40b87c0 msgr2=0x7f66b40b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- 172.21.15.16:0/521584627 shutdown_connections 2024-04-26T22:21:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- 172.21.15.16:0/521584627 wait complete. 2024-04-26T22:21:37.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 Processor -- start 2024-04-26T22:21:37.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- start start 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b40a07d0 0x7f66b413c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66b40a0bb0 0x7f66b4146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4155f10 con 0x7f66b41489c0 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f66b4155d90 con 0x7f66b40a07d0 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66bac00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f66b4156090 con 0x7f66b40a0bb0 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41522/0 (socket says 172.21.15.16:41522) 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:36.999+0000 7f66b8c00640 1 -- 172.21.15.16:0/3393578236 learned_addr learned my addr 172.21.15.16:0/3393578236 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66ab400640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66b40a0bb0 0x7f66b4146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b3e00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b40a07d0 0x7f66b413c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 -- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66b40a0bb0 msgr2=0x7f66b4146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66b40a0bb0 0x7f66b4146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 -- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b40a07d0 msgr2=0x7f66b413c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b40a07d0 0x7f66b413c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 -- 172.21.15.16:0/3393578236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b4140c80 con 0x7f66b41489c0 2024-04-26T22:21:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b8c00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00efc0 tx=0x7f66ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac018020 con 0x7f66b41489c0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ac014480 con 0x7f66b41489c0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac014870 con 0x7f66b41489c0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b4140f60 con 0x7f66b41489c0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b4142650 con 0x7f66b41489c0 2024-04-26T22:21:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b4069530 con 0x7f66b41489c0 2024-04-26T22:21:37.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.003+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66ac01b020 con 0x7f66b41489c0 2024-04-26T22:21:37.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.007+0000 7f66b0c00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 0x7f669006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:37.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.007+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66ac087630 con 0x7f66b41489c0 2024-04-26T22:21:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.007+0000 7f66b3e00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 0x7f669006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.007+0000 7f66b3e00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 0x7f669006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66a40ae000 tx=0x7f66a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:37.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.011+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66ac022030 con 0x7f66b41489c0 2024-04-26T22:21:37.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.211+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66b4146760 con 0x7f66b41489c0 2024-04-26T22:21:37.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.211+0000 7f66b0c00640 1 -- 172.21.15.16:0/3393578236 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f66ac010040 con 0x7f66b41489c0 2024-04-26T22:21:37.215 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:21:37.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 msgr2=0x7f669006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:37.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 0x7f669006a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66a40ae000 tx=0x7f66a40a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 msgr2=0x7f66b41e4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66ac00efc0 tx=0x7f66ac00c490 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 shutdown_connections 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6690068380 0x7f669006a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66b41489c0 0x7f66b41e4090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f66b40a0bb0 0x7f66b4146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 --2- 172.21.15.16:0/3393578236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66b40a07d0 0x7f66b413c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 >> 172.21.15.16:0/3393578236 conn(0x7f66b40b87c0 msgr2=0x7f66b40b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 shutdown_connections 2024-04-26T22:21:37.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37.215+0000 7f66bac00640 1 -- 172.21.15.16:0/3393578236 wait complete. 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:21:37.236 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:21:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:37.237 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-26T22:21:37.245 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:21:37.245 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:21:37.246 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:d9:94:62:67 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T22:21:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:21:37.248 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T22:21:37.249 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:21:37.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:21:37.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:37.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:37.406 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:21:37.425 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-26T22:21:37.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:37.427 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-26T22:21:37.501 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-26T22:21:37.501 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:21:37.501 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T22:21:37.501 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T22:21:37.501 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T22:21:37.502 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T22:21:37.502 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:21:37.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:21:37.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:37.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:37.644 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T22:21:37.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:37.653 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-26T22:21:37.707 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:21:37.708 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:21:37.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:37.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T22:21:37.708 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:21:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:21:37.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:37.836 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T22:21:37.837 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:21:37.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:21:37.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:38.002 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:21:38.002 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:21:38.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-26T22:21:38.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T22:21:38.002 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:21:38.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:21:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:38.133 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T22:21:38.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:21:38.133 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:38.183 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:21:38.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:21:38.183 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:38.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T22:21:38.296 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T22:21:38.353 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T22:21:38.354 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:38.355 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:38.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:38.356 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T22:21:38.412 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T22:21:38.412 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T22:21:38.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T22:21:38.478 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T22:21:38.529 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T22:21:38.530 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T22:21:38.531 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T22:21:38.531 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T22:21:38.531 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T22:21:38.531 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:38.531 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:38.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:38.532 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T22:21:38.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:2024-04-26T22:21:38.551+0000 7fe9e5f0e580 -1 init, newargv = 0x558c87ab7600 newargc=15 2024-04-26T22:21:38.556 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[33440]: starting ceph client 2024-04-26T22:21:38.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[33440]: starting fuse 2024-04-26T22:21:39.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T22:21:39.690 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T22:21:39.745 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T22:21:39.745 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T22:21:39.746 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:21:39.747 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:39.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:39.748 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T22:21:39.800 INFO:teuthology.orchestra.run.smithi016.stdout:44 2024-04-26T22:21:39.800 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T22:21:39.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo stdin-killer -- python3 -c ' 2024-04-26T22:21:39.800 DEBUG:teuthology.orchestra.run.smithi016:> import glob 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> import re 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> import os 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> import subprocess 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> def _find_admin_socket(client_name): 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> files = glob.glob(asok_path) 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> # Given a non-glob path, it better be there 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> if "*" not in asok_path: 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> assert(len(files) == 1) 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> return files[0] 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:21:39.801 DEBUG:teuthology.orchestra.run.smithi016:> for f in files: 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> contents = proc_f.read() 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> if mountpoint in contents: 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> return f 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> print(_find_admin_socket("client.0")) 2024-04-26T22:21:39.802 DEBUG:teuthology.orchestra.run.smithi016:> ' 2024-04-26T22:21:39.939 INFO:teuthology.orchestra.run.smithi016.stdout:/var/run/ceph/ceph-client.0.33440.asok 2024-04-26T22:21:39.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:21:39.952 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33440.asok 2024-04-26T22:21:39.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:39.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33440.asok status 2024-04-26T22:21:40.132 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "metadata": { 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "entity_id": "0", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": "smithi016", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "pid": "33440", 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "root": "/" 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_count": 0, 2024-04-26T22:21:40.133 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_pinned_count": 0, 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4650, 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "inst": { 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "name": { 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "client", 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "num": 4650 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T22:21:40.134 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 2135606101 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 2135606101 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "inst_str": "client.4650 192.168.0.1:0/2135606101", 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "addr_str": "192.168.0.1:0/2135606101", 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "inode_count": 1, 2024-04-26T22:21:40.135 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_epoch": 8, 2024-04-26T22:21:40.136 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch": 22, 2024-04-26T22:21:40.136 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch_barrier": 0, 2024-04-26T22:21:40.136 INFO:teuthology.orchestra.run.smithi016.stdout: "blocklisted": false, 2024-04-26T22:21:40.136 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs" 2024-04-26T22:21:40.136 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:21:40.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:40.148 DEBUG:teuthology.orchestra.run.smithi016:> stat --file-system '--printf=%T 2024-04-26T22:21:40.148 DEBUG:teuthology.orchestra.run.smithi016:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:40.159 INFO:teuthology.orchestra.run.smithi016.stdout:fuseblk 2024-04-26T22:21:40.159 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:40.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:40.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:40.224 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T22:21:40.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.403+0000 7f654e800640 1 Processor -- start 2024-04-26T22:21:40.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.403+0000 7f654e800640 1 -- start start 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f654e800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65480b6890 0x7f65480b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f654e800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6548068780 con 0x7f65480683a0 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f654e800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65480b6210 con 0x7f65480b5d30 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f654e800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f65480b64f0 con 0x7f65480b6890 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f6547400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f65480683a0 0x7f6548073820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40916/0 (socket says 172.21.15.16:40916) 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f6547400640 1 -- 172.21.15.16:0/141464573 learned_addr learned my addr 172.21.15.16:0/141464573 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:40.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f653ea00640 1 --2- 172.21.15.16:0/141464573 >> v2:172.21.15.195:3300/0 conn(0x7f65480b6890 0x7f65480b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941959759 0 0) 0x7f6548068780 con 0x7f65480683a0 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c003530 con 0x7f65480683a0 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f653ea00640 1 -- 172.21.15.16:0/141464573 >> v1:172.21.15.195:6789/0 conn(0x7f65480b5d30 legacy=0x7f6548148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f653ea00640 1 -- 172.21.15.16:0/141464573 >> v1:172.21.15.16:6789/0 conn(0x7f65480683a0 legacy=0x7f6548073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1896795142 0 0) 0x7f652c003530 con 0x7f65480683a0 2024-04-26T22:21:40.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.407+0000 7f653ea00640 1 -- 172.21.15.16:0/141464573 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480a0380 con 0x7f65480b6890 2024-04-26T22:21:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f653ea00640 1 --2- 172.21.15.16:0/141464573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b6890 0x7f65480b6d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65300097c0 tx=0x7f653001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fed884557651d8c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65300b0070 con 0x7f65480b6890 2024-04-26T22:21:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65300a4e50 con 0x7f65480b6890 2024-04-26T22:21:40.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6546a00640 1 -- 172.21.15.16:0/141464573 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538001680 con 0x7f65480b6890 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- 172.21.15.16:0/141464573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b6890 msgr2=0x7f65480b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 --2- 172.21.15.16:0/141464573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b6890 0x7f65480b6d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f65300097c0 tx=0x7f653001c330 comp rx=0 tx=0).stop 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- 172.21.15.16:0/141464573 shutdown_connections 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 --2- 172.21.15.16:0/141464573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b6890 0x7f65480b6d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- 172.21.15.16:0/141464573 >> 172.21.15.16:0/141464573 conn(0x7f65480bab10 msgr2=0x7f65480baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- 172.21.15.16:0/141464573 shutdown_connections 2024-04-26T22:21:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- 172.21.15.16:0/141464573 wait complete. 2024-04-26T22:21:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 Processor -- start 2024-04-26T22:21:40.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- start start 2024-04-26T22:21:40.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65480683a0 0x7f654814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b5d30 0x7f65480b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6548156c10 con 0x7f65480b6890 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6548156a90 con 0x7f65480b5d30 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f654e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6548156d90 con 0x7f65480683a0 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6547e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6547e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41534/0 (socket says 172.21.15.16:41534) 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6547e00640 1 -- 172.21.15.16:0/3088035555 learned_addr learned my addr 172.21.15.16:0/3088035555 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.411+0000 7f6547400640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65480683a0 0x7f654814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f653ea00640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b5d30 0x7f65480b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 -- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65480683a0 msgr2=0x7f654814c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65480683a0 0x7f654814c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 -- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b5d30 msgr2=0x7f65480b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b5d30 0x7f65480b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 -- 172.21.15.16:0/3088035555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480b2f70 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f6547e00640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f654000c7a0 tx=0x7f654000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540003b80 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6540003d20 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65480b31f0 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654000aa30 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6548142650 con 0x7f65480b6890 2024-04-26T22:21:40.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65480b2120 con 0x7f65480b6890 2024-04-26T22:21:40.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.415+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f654000abd0 con 0x7f65480b6890 2024-04-26T22:21:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.419+0000 7f653fe00640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 0x7f652406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.419+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6540086760 con 0x7f65480b6890 2024-04-26T22:21:40.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.419+0000 7f6547400640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 0x7f652406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.419+0000 7f6547400640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 0x7f652406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6538005890 tx=0x7f6538005800 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.423+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f65480b2f70 con 0x7f65480b6890 2024-04-26T22:21:40.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.587+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65480b1ed0 con 0x7f65480b6890 2024-04-26T22:21:40.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.587+0000 7f653fe00640 1 -- 172.21.15.16:0/3088035555 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f65400566c0 con 0x7f65480b6890 2024-04-26T22:21:40.591 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:40.591 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 msgr2=0x7f652406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 0x7f652406a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6538005890 tx=0x7f6538005800 comp rx=0 tx=0).stop 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 msgr2=0x7f65481e0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f654000c7a0 tx=0x7f654000cc60 comp rx=0 tx=0).stop 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 shutdown_connections 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6524068380 0x7f652406a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65480b6890 0x7f65481e0ef0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65480b5d30 0x7f65480b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 --2- 172.21.15.16:0/3088035555 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65480683a0 0x7f654814c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 >> 172.21.15.16:0/3088035555 conn(0x7f65480bab10 msgr2=0x7f654813fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 shutdown_connections 2024-04-26T22:21:40.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.591+0000 7f654e800640 1 -- 172.21.15.16:0/3088035555 wait complete. 2024-04-26T22:21:40.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:40.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:40.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 Processor -- start 2024-04-26T22:21:40.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 -- start start 2024-04-26T22:21:40.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f85b40b6b60 0x7f85b4149470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b40b5520 con 0x7f85b4073750 2024-04-26T22:21:40.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b40b5cc0 con 0x7f85b40683a0 2024-04-26T22:21:40.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85ba000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f85b4068780 con 0x7f85b40b6b60 2024-04-26T22:21:40.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85aaa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f85b40b6b60 0x7f85b4149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85b3e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f85b4073750 0x7f85b4152e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40930/0 (socket says 172.21.15.16:40930) 2024-04-26T22:21:40.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85b3e00640 1 -- 172.21.15.16:0/3146871213 learned_addr learned my addr 172.21.15.16:0/3146871213 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:40.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85aaa00640 1 -- 172.21.15.16:0/3146871213 >> v1:172.21.15.195:6789/0 conn(0x7f85b40683a0 legacy=0x7f85b4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85aaa00640 1 -- 172.21.15.16:0/3146871213 >> v1:172.21.15.16:6789/0 conn(0x7f85b4073750 legacy=0x7f85b4152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85aaa00640 1 -- 172.21.15.16:0/3146871213 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b40a0e30 con 0x7f85b40b6b60 2024-04-26T22:21:40.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.755+0000 7f85b2a00640 1 -- 172.21.15.16:0/3146871213 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656885435 0 0) 0x7f85b40b5520 con 0x7f85b4073750 2024-04-26T22:21:40.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85aaa00640 1 --2- 172.21.15.16:0/3146871213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b40b6b60 0x7f85b4149470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6dfad0c925e071 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85b2a00640 1 -- 172.21.15.16:0/3146871213 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b0070 con 0x7f85b40b6b60 2024-04-26T22:21:40.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85b2a00640 1 -- 172.21.15.16:0/3146871213 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c0ab600 con 0x7f85b40b6b60 2024-04-26T22:21:40.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85b2a00640 1 -- 172.21.15.16:0/3146871213 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ab9d0 con 0x7f85b40b6b60 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 -- 172.21.15.16:0/3146871213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b40b6b60 msgr2=0x7f85b4149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 --2- 172.21.15.16:0/3146871213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b40b6b60 0x7f85b4149470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01c410 comp rx=0 tx=0).stop 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 -- 172.21.15.16:0/3146871213 shutdown_connections 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 --2- 172.21.15.16:0/3146871213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b40b6b60 0x7f85b4149470 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 -- 172.21.15.16:0/3146871213 >> 172.21.15.16:0/3146871213 conn(0x7f85b406e2e0 msgr2=0x7f85b406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:40.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 -- 172.21.15.16:0/3146871213 shutdown_connections 2024-04-26T22:21:40.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 -- 172.21.15.16:0/3146871213 wait complete. 2024-04-26T22:21:40.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.759+0000 7f85ba000640 1 Processor -- start 2024-04-26T22:21:40.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- start start 2024-04-26T22:21:40.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85b40683a0 0x7f85b41e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 0x7f85b413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85b4156fc0 con 0x7f85b4073750 2024-04-26T22:21:40.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40a0a30 con 0x7f85b40b6b60 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f85b4157140 con 0x7f85b40683a0 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41552/0 (socket says 172.21.15.16:41552) 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 -- 172.21.15.16:0/631208568 learned_addr learned my addr 172.21.15.16:0/631208568 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85b3400640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85b40683a0 0x7f85b41e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85b3e00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 0x7f85b413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 -- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85b40683a0 msgr2=0x7f85b41e55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85b40683a0 0x7f85b41e55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 -- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 msgr2=0x7f85b413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 0x7f85b413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 -- 172.21.15.16:0/631208568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b41478a0 con 0x7f85b4073750 2024-04-26T22:21:40.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85b3e00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 0x7f85b413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:40.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85aaa00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b0050 con 0x7f85b4073750 2024-04-26T22:21:40.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c0bc070 con 0x7f85b4073750 2024-04-26T22:21:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b5a30 con 0x7f85b4073750 2024-04-26T22:21:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b41465d0 con 0x7f85b4073750 2024-04-26T22:21:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b4147340 con 0x7f85b4073750 2024-04-26T22:21:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.763+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4069530 con 0x7f85b4073750 2024-04-26T22:21:40.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.767+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f859c0ab4c0 con 0x7f85b4073750 2024-04-26T22:21:40.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.767+0000 7f85abe00640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 0x7f859006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:40.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.767+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f859c1210a0 con 0x7f85b4073750 2024-04-26T22:21:40.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.767+0000 7f85b3400640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 0x7f859006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:40.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.767+0000 7f85b3400640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 0x7f859006a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85a4007fd0 tx=0x7f85a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:40.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.771+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f859c016090 con 0x7f85b4073750 2024-04-26T22:21:40.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85b40b6810 con 0x7f85b4073750 2024-04-26T22:21:40.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85abe00640 1 -- 172.21.15.16:0/631208568 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f859c0f16f0 con 0x7f85b4073750 2024-04-26T22:21:40.940 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 msgr2=0x7f859006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 0x7f859006a870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85a4007fd0 tx=0x7f85a4009040 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 msgr2=0x7f85b41e4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01ac50 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 shutdown_connections 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f85900683b0 0x7f859006a870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85b40b6b60 0x7f85b413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85b4073750 0x7f85b41e4cc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 --2- 172.21.15.16:0/631208568 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f85b40683a0 0x7f85b41e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 >> 172.21.15.16:0/631208568 conn(0x7f85b406e2e0 msgr2=0x7f85b406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 shutdown_connections 2024-04-26T22:21:40.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:40.939+0000 7f85ba000640 1 -- 172.21.15.16:0/631208568 wait complete. 2024-04-26T22:21:40.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:41.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 Processor -- start 2024-04-26T22:21:41.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 -- start start 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe65c151df0 0x7fe65c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65c0a12d0 con 0x7fe65c0b7880 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65c0b6ed0 con 0x7fe65c073860 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe663000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c0b7210 con 0x7fe65c151df0 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe653400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe65c0b7880 0x7fe65c070010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40942/0 (socket says 172.21.15.16:40942) 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe653400640 1 -- 172.21.15.16:0/2386854127 learned_addr learned my addr 172.21.15.16:0/2386854127 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:41.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe661000640 1 --2- 172.21.15.16:0/2386854127 >> v2:172.21.15.195:3300/0 conn(0x7fe65c151df0 0x7fe65c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436134501 0 0) 0x7fe65c0a12d0 con 0x7fe65c0b7880 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe640003530 con 0x7fe65c0b7880 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.103+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970783905 0 0) 0x7fe65c0b6ed0 con 0x7fe65c073860 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe65c0a12d0 con 0x7fe65c073860 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe661000640 1 -- 172.21.15.16:0/2386854127 >> v1:172.21.15.195:6789/0 conn(0x7fe65c073860 legacy=0x7fe65c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe661000640 1 -- 172.21.15.16:0/2386854127 >> v1:172.21.15.16:6789/0 conn(0x7fe65c0b7880 legacy=0x7fe65c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe661000640 1 -- 172.21.15.16:0/2386854127 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c073c40 con 0x7fe65c151df0 2024-04-26T22:21:41.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe661000640 1 --2- 172.21.15.16:0/2386854127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c151df0 0x7fe65c1541e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe654009d90 tx=0x7fe65401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b21e94532392e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540b2070 con 0x7fe65c151df0 2024-04-26T22:21:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6540a5850 con 0x7fe65c151df0 2024-04-26T22:21:41.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe65b400640 1 -- 172.21.15.16:0/2386854127 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540a5c20 con 0x7fe65c151df0 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 -- 172.21.15.16:0/2386854127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c151df0 msgr2=0x7fe65c1541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 --2- 172.21.15.16:0/2386854127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c151df0 0x7fe65c1541e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe654009d90 tx=0x7fe65401c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 -- 172.21.15.16:0/2386854127 shutdown_connections 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 --2- 172.21.15.16:0/2386854127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c151df0 0x7fe65c1541e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 -- 172.21.15.16:0/2386854127 >> 172.21.15.16:0/2386854127 conn(0x7fe65c0b8850 msgr2=0x7fe65c0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 -- 172.21.15.16:0/2386854127 shutdown_connections 2024-04-26T22:21:41.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.107+0000 7fe663000640 1 -- 172.21.15.16:0/2386854127 wait complete. 2024-04-26T22:21:41.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 Processor -- start 2024-04-26T22:21:41.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- start start 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe65c073860 0x7fe65c1e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c1453b0 0x7fe65c137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c142cd0 con 0x7fe65c151df0 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c142b50 con 0x7fe65c1453b0 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c070720 con 0x7fe65c073860 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41564/0 (socket says 172.21.15.16:41564) 2024-04-26T22:21:41.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 -- 172.21.15.16:0/42847745 learned_addr learned my addr 172.21.15.16:0/42847745 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe661000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c1453b0 0x7fe65c137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe65be00640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe65c073860 0x7fe65c1e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 -- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe65c073860 msgr2=0x7fe65c1e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe65c073860 0x7fe65c1e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 -- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c1453b0 msgr2=0x7fe65c137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c1453b0 0x7fe65c137c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 -- 172.21.15.16:0/42847745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c0b0e10 con 0x7fe65c151df0 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe653400640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c530 tx=0x7fe64400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644017070 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644005cf0 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c0b10f0 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644007290 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.111+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c1e45e0 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.115+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c1e4810 con 0x7fe65c151df0 2024-04-26T22:21:41.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.115+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe64401a070 con 0x7fe65c151df0 2024-04-26T22:21:41.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.115+0000 7fe658c00640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 0x7fe63806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.115+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe644085dc0 con 0x7fe65c151df0 2024-04-26T22:21:41.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.115+0000 7fe65be00640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 0x7fe63806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.119+0000 7fe65be00640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 0x7fe63806a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0011f0 tx=0x7fe64c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.119+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe65c1e4810 con 0x7fe65c151df0 2024-04-26T22:21:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe65c13fad0 con 0x7fe65c151df0 2024-04-26T22:21:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe658c00640 1 -- 172.21.15.16:0/42847745 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fe64405c070 con 0x7fe65c151df0 2024-04-26T22:21:41.289 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 msgr2=0x7fe63806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 0x7fe63806a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0011f0 tx=0x7fe64c009040 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 msgr2=0x7fe65c13fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c530 tx=0x7fe64400c9f0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 shutdown_connections 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe638068380 0x7fe63806a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe65c1453b0 0x7fe65c137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe65c151df0 0x7fe65c13fdb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 --2- 172.21.15.16:0/42847745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe65c073860 0x7fe65c1e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 >> 172.21.15.16:0/42847745 conn(0x7fe65c0b8850 msgr2=0x7fe65c148580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 shutdown_connections 2024-04-26T22:21:41.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.287+0000 7fe663000640 1 -- 172.21.15.16:0/42847745 wait complete. 2024-04-26T22:21:41.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:41.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 Processor -- start 2024-04-26T22:21:41.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 -- start start 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f48a006e410 0x7f48a00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a006e7f0 con 0x7f48a01465c0 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a0070760 con 0x7f48a013eec0 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f48a5600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f48a0070a40 con 0x7f48a006e410 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f4896000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f48a01465c0 0x7f48a0149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40944/0 (socket says 172.21.15.16:40944) 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f4896000640 1 -- 172.21.15.16:0/3975297381 learned_addr learned my addr 172.21.15.16:0/3975297381 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:41.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489ea00640 1 --2- 172.21.15.16:0/3975297381 >> v2:172.21.15.195:3300/0 conn(0x7f48a006e410 0x7f48a00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482696063 0 0) 0x7f48a006e7f0 con 0x7f48a01465c0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4884005740 con 0x7f48a01465c0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642604227 0 0) 0x7f48a0070760 con 0x7f48a013eec0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a006e7f0 con 0x7f48a013eec0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4074317865 0 0) 0x7f4884005740 con 0x7f48a01465c0 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489ea00640 1 -- 172.21.15.16:0/3975297381 >> v1:172.21.15.195:6789/0 conn(0x7f48a013eec0 legacy=0x7f48a013f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489ea00640 1 -- 172.21.15.16:0/3975297381 >> v1:172.21.15.16:6789/0 conn(0x7f48a01465c0 legacy=0x7f48a0149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.451+0000 7f489ea00640 1 -- 172.21.15.16:0/3975297381 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a0148860 con 0x7f48a006e410 2024-04-26T22:21:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f489ea00640 1 --2- 172.21.15.16:0/3975297381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a006e410 0x7f48a00b30d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48900097c0 tx=0x7f489001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3262a1e5895bf3d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48900b0070 con 0x7f48a006e410 2024-04-26T22:21:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48900ab400 con 0x7f48a006e410 2024-04-26T22:21:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f489e000640 1 -- 172.21.15.16:0/3975297381 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888001680 con 0x7f48a006e410 2024-04-26T22:21:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 -- 172.21.15.16:0/3975297381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a006e410 msgr2=0x7f48a00b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 --2- 172.21.15.16:0/3975297381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a006e410 0x7f48a00b30d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48900097c0 tx=0x7f489001c330 comp rx=0 tx=0).stop 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 -- 172.21.15.16:0/3975297381 shutdown_connections 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 --2- 172.21.15.16:0/3975297381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a006e410 0x7f48a00b30d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 -- 172.21.15.16:0/3975297381 >> 172.21.15.16:0/3975297381 conn(0x7f48a00b6590 msgr2=0x7f48a00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 -- 172.21.15.16:0/3975297381 shutdown_connections 2024-04-26T22:21:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.455+0000 7f48a5600640 1 -- 172.21.15.16:0/3975297381 wait complete. 2024-04-26T22:21:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 Processor -- start 2024-04-26T22:21:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- start start 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 0x7f48a01332b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a01465c0 0x7f48a01e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00b50b0 con 0x7f48a013eec0 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f48a00b4f30 con 0x7f48a01465c0 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f48a00b5230 con 0x7f48a006e410 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41574/0 (socket says 172.21.15.16:41574) 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 -- 172.21.15.16:0/2892089636 learned_addr learned my addr 172.21.15.16:0/2892089636 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f489ea00640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 0x7f48a01332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f489f400640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a01465c0 0x7f48a01e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 -- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 msgr2=0x7f48a01332b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 0x7f48a01332b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 -- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a01465c0 msgr2=0x7f48a01e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a01465c0 0x7f48a01e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 -- 172.21.15.16:0/2892089636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a00b89c0 con 0x7f48a013eec0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f489ea00640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 0x7f48a01332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4896000640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f488800c760 tx=0x7f488800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888017070 con 0x7f48a013eec0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4888005b00 con 0x7f48a013eec0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888007070 con 0x7f48a013eec0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a00b8ca0 con 0x7f48a013eec0 2024-04-26T22:21:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a0136e30 con 0x7f48a013eec0 2024-04-26T22:21:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.459+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a0069530 con 0x7f48a013eec0 2024-04-26T22:21:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.463+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f488801a070 con 0x7f48a013eec0 2024-04-26T22:21:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.463+0000 7f4897400640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.463+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4888085ea0 con 0x7f48a013eec0 2024-04-26T22:21:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.463+0000 7f489ea00640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.463+0000 7f489ea00640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 0x7f487c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f48900ad000 tx=0x7f4890008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.467+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4888056450 con 0x7f48a013eec0 2024-04-26T22:21:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.631+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48a00b9150 con 0x7f48a013eec0 2024-04-26T22:21:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.631+0000 7f4897400640 1 -- 172.21.15.16:0/2892089636 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f4888055d50 con 0x7f48a013eec0 2024-04-26T22:21:41.636 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 msgr2=0x7f487c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 0x7f487c06a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f48900ad000 tx=0x7f4890008040 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 msgr2=0x7f48a00b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f488800c760 tx=0x7f488800cc20 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 shutdown_connections 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f487c068380 0x7f487c06a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a01465c0 0x7f48a01e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48a013eec0 0x7f48a00b82a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 --2- 172.21.15.16:0/2892089636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f48a006e410 0x7f48a01332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 >> 172.21.15.16:0/2892089636 conn(0x7f48a00b6590 msgr2=0x7f48a006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 shutdown_connections 2024-04-26T22:21:41.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.635+0000 7f48a5600640 1 -- 172.21.15.16:0/2892089636 wait complete. 2024-04-26T22:21:41.657 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:41.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 Processor -- start 2024-04-26T22:21:41.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 -- start start 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4440b86b0 0x7fd4440b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd444146930 0x7fd4440b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4440b3830 con 0x7fd444073d40 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440b7ce0 con 0x7fd4440b86b0 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd44a600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440b7390 con 0x7fd444146930 2024-04-26T22:21:41.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4440b86b0 0x7fd4440b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4440b86b0 0x7fd4440b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41582/0 (socket says 172.21.15.16:41582) 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 -- 172.21.15.16:0/2098626573 learned_addr learned my addr 172.21.15.16:0/2098626573 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449c00640 1 --2- 172.21.15.16:0/2098626573 >> v2:172.21.15.195:3300/0 conn(0x7fd444146930 0x7fd4440b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 -- 172.21.15.16:0/2098626573 >> v2:172.21.15.195:3300/0 conn(0x7fd444146930 msgr2=0x7fd4440b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 --2- 172.21.15.16:0/2098626573 >> v2:172.21.15.195:3300/0 conn(0x7fd444146930 0x7fd4440b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 -- 172.21.15.16:0/2098626573 >> v1:172.21.15.195:6789/0 conn(0x7fd444073d40 legacy=0x7fd444146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.795+0000 7fd449200640 1 -- 172.21.15.16:0/2098626573 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440b79e0 con 0x7fd4440b86b0 2024-04-26T22:21:41.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd449200640 1 --2- 172.21.15.16:0/2098626573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4440b86b0 0x7fd4440b5390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b2f10 tx=0x7fd43401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7172b63b7e6adc50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd443e00640 1 -- 172.21.15.16:0/2098626573 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340aa610 con 0x7fd4440b86b0 2024-04-26T22:21:41.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd443e00640 1 -- 172.21.15.16:0/2098626573 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4340af070 con 0x7fd4440b86b0 2024-04-26T22:21:41.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd443e00640 1 -- 172.21.15.16:0/2098626573 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340aa9d0 con 0x7fd4440b86b0 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 -- 172.21.15.16:0/2098626573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4440b86b0 msgr2=0x7fd4440b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 --2- 172.21.15.16:0/2098626573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4440b86b0 0x7fd4440b5390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b2f10 tx=0x7fd43401c490 comp rx=0 tx=0).stop 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 -- 172.21.15.16:0/2098626573 shutdown_connections 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 --2- 172.21.15.16:0/2098626573 >> v2:172.21.15.195:3300/0 conn(0x7fd444146930 0x7fd4440b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 --2- 172.21.15.16:0/2098626573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4440b86b0 0x7fd4440b5390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 -- 172.21.15.16:0/2098626573 >> 172.21.15.16:0/2098626573 conn(0x7fd444068140 msgr2=0x7fd444068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 -- 172.21.15.16:0/2098626573 shutdown_connections 2024-04-26T22:21:41.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.799+0000 7fd44a600640 1 -- 172.21.15.16:0/2098626573 wait complete. 2024-04-26T22:21:41.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 Processor -- start 2024-04-26T22:21:41.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- start start 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd444073d40 0x7fd4441330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4440b86b0 0x7fd4440bb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4441532e0 con 0x7fd444146930 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b6de0 con 0x7fd4440b86b0 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd444153460 con 0x7fd444073d40 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41594/0 (socket says 172.21.15.16:41594) 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 -- 172.21.15.16:0/1126663532 learned_addr learned my addr 172.21.15.16:0/1126663532 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:41.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd43be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4440b86b0 0x7fd4440bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449200640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd444073d40 0x7fd4441330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 -- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd444073d40 msgr2=0x7fd4441330c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd444073d40 0x7fd4441330c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 -- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4440b86b0 msgr2=0x7fd4440bb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4440b86b0 0x7fd4440bb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 -- 172.21.15.16:0/1126663532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44413eeb0 con 0x7fd444146930 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd449c00640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009d30 tx=0x7fd43c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c018020 con 0x7fd444146930 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c014480 con 0x7fd444146930 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c014870 con 0x7fd444146930 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4441337d0 con 0x7fd444146930 2024-04-26T22:21:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.803+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44413e090 con 0x7fd444146930 2024-04-26T22:21:41.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4440507b0 con 0x7fd444146930 2024-04-26T22:21:41.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd43c01b020 con 0x7fd444146930 2024-04-26T22:21:41.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd441600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 0x7fd42006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:41.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd43c087220 con 0x7fd444146930 2024-04-26T22:21:41.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd449200640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 0x7fd42006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:41.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.807+0000 7fd449200640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 0x7fd42006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4340ae000 tx=0x7fd4340a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:41.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.811+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd43c022070 con 0x7fd444146930 2024-04-26T22:21:41.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.975+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4440b34e0 con 0x7fd444146930 2024-04-26T22:21:41.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.975+0000 7fd441600640 1 -- 172.21.15.16:0/1126663532 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fd4441337d0 con 0x7fd444146930 2024-04-26T22:21:41.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:41.980 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 msgr2=0x7fd42006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 0x7fd42006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4340ae000 tx=0x7fd4340a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 msgr2=0x7fd44413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009d30 tx=0x7fd43c00c490 comp rx=0 tx=0).stop 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 shutdown_connections 2024-04-26T22:21:41.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd420068380 0x7fd42006a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd444146930 0x7fd44413f890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4440b86b0 0x7fd4440bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 --2- 172.21.15.16:0/1126663532 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd444073d40 0x7fd4441330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 >> 172.21.15.16:0/1126663532 conn(0x7fd444068140 msgr2=0x7fd4440b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 shutdown_connections 2024-04-26T22:21:41.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:41.979+0000 7fd44a600640 1 -- 172.21.15.16:0/1126663532 wait complete. 2024-04-26T22:21:42.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:42.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 Processor -- start 2024-04-26T22:21:42.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 -- start start 2024-04-26T22:21:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f419013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41900b0a30 0x7f4190140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4190070480 con 0x7f41901464e0 2024-04-26T22:21:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4190070a60 con 0x7f41900b0a30 2024-04-26T22:21:42.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4195e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41900718a0 con 0x7f419006e410 2024-04-26T22:21:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f418ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f419013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41900b0a30 0x7f4190140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41900b0a30 0x7f4190140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:56402/0 (socket says 172.21.15.16:56402) 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 -- 172.21.15.16:0/1364434954 learned_addr learned my addr 172.21.15.16:0/1364434954 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f418ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f419013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:34588/0 (socket says 172.21.15.16:34588) 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 -- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 msgr2=0x7f419013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 --2- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f419013ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 -- 172.21.15.16:0/1364434954 >> v1:172.21.15.195:6789/0 conn(0x7f41901464e0 legacy=0x7f4190146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f4187e00640 1 -- 172.21.15.16:0/1364434954 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419006e7f0 con 0x7f41900b0a30 2024-04-26T22:21:42.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.143+0000 7f418e000640 1 -- 172.21.15.16:0/1364434954 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618134485 0 0) 0x7f4190070480 con 0x7f41901464e0 2024-04-26T22:21:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4187e00640 1 --2- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f4190140510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4178009870 tx=0x7f417801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4a927a14841d32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f418e000640 1 -- 172.21.15.16:0/1364434954 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41780aa620 con 0x7f41900b0a30 2024-04-26T22:21:42.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f418e000640 1 -- 172.21.15.16:0/1364434954 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41780af070 con 0x7f41900b0a30 2024-04-26T22:21:42.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f418e000640 1 -- 172.21.15.16:0/1364434954 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41780aa9e0 con 0x7f41900b0a30 2024-04-26T22:21:42.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 -- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 msgr2=0x7f4190140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 --2- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f4190140510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4178009870 tx=0x7f417801c4a0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 -- 172.21.15.16:0/1364434954 shutdown_connections 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 --2- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f4190140510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 --2- 172.21.15.16:0/1364434954 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f419013ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 -- 172.21.15.16:0/1364434954 >> 172.21.15.16:0/1364434954 conn(0x7f41900b6590 msgr2=0x7f41900b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 -- 172.21.15.16:0/1364434954 shutdown_connections 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.147+0000 7f4195e00640 1 -- 172.21.15.16:0/1364434954 wait complete. 2024-04-26T22:21:42.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 Processor -- start 2024-04-26T22:21:42.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- start start 2024-04-26T22:21:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f4190073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f41900b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4190153520 con 0x7f41901464e0 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f41901533a0 con 0x7f41900b0a30 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41901536a0 con 0x7f419006e410 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41598/0 (socket says 172.21.15.16:41598) 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 -- 172.21.15.16:0/1068809929 learned_addr learned my addr 172.21.15.16:0/1068809929 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4187e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f41900b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418ea00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f4190073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 -- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 msgr2=0x7f4190073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f4190073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 -- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 msgr2=0x7f41900b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f41900b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 -- 172.21.15.16:0/1068809929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41900b3170 con 0x7f41901464e0 2024-04-26T22:21:42.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f418f400640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f418800c780 tx=0x7f418800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188003db0 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188005070 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4190142e90 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188005460 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.151+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4190143930 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190069530 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4188005600 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f4187400640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 0x7f416c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4188086790 con 0x7f41901464e0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f418ea00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 0x7f416c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.155+0000 7f418ea00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 0x7f416c06a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4180009ac0 tx=0x7f4180009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.159+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f41880566f0 con 0x7f41901464e0 2024-04-26T22:21:42.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4190142bb0 con 0x7f41901464e0 2024-04-26T22:21:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4187400640 1 -- 172.21.15.16:0/1068809929 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f418805a9f0 con 0x7f41901464e0 2024-04-26T22:21:42.329 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 msgr2=0x7f416c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 0x7f416c06a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4180009ac0 tx=0x7f4180009190 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 msgr2=0x7f419013adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f418800c780 tx=0x7f418800cc40 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 shutdown_connections 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f416c0683b0 0x7f416c06a870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41901464e0 0x7f419013adf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41900b0a30 0x7f41900b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 --2- 172.21.15.16:0/1068809929 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f419006e410 0x7f4190073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 >> 172.21.15.16:0/1068809929 conn(0x7f41900b6590 msgr2=0x7f419013e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:42.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 shutdown_connections 2024-04-26T22:21:42.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.327+0000 7f4195e00640 1 -- 172.21.15.16:0/1068809929 wait complete. 2024-04-26T22:21:42.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:42.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 Processor -- start 2024-04-26T22:21:42.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 -- start start 2024-04-26T22:21:42.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbce00b0a30 0x7fbce01464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbce01406e0 0x7fbce0146a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce0070480 con 0x7fbce006e410 2024-04-26T22:21:42.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbce0070a60 con 0x7fbce01406e0 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce7600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbce00718a0 con 0x7fbce00b0a30 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce5600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbce01406e0 0x7fbce0146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce5600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbce01406e0 0x7fbce0146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41614/0 (socket says 172.21.15.16:41614) 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce5600640 1 -- 172.21.15.16:0/1890792925 learned_addr learned my addr 172.21.15.16:0/1890792925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbce4c00640 1 --1- 172.21.15.16:0/1890792925 >> v1:172.21.15.16:6789/0 conn(0x7fbce006e410 0x7fbce013ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40946/0 (socket says 172.21.15.16:40946) 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.491+0000 7fbcd7e00640 1 --2- 172.21.15.16:0/1890792925 >> v2:172.21.15.195:3300/0 conn(0x7fbce00b0a30 0x7fbce01464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce5600640 1 -- 172.21.15.16:0/1890792925 >> v2:172.21.15.195:3300/0 conn(0x7fbce00b0a30 msgr2=0x7fbce01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce5600640 1 --2- 172.21.15.16:0/1890792925 >> v2:172.21.15.195:3300/0 conn(0x7fbce00b0a30 0x7fbce01464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce5600640 1 -- 172.21.15.16:0/1890792925 >> v1:172.21.15.16:6789/0 conn(0x7fbce006e410 legacy=0x7fbce013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce5600640 1 -- 172.21.15.16:0/1890792925 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce006e7f0 con 0x7fbce01406e0 2024-04-26T22:21:42.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce5600640 1 --2- 172.21.15.16:0/1890792925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce01406e0 0x7fbce0146a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbce006ea30 tx=0x7fbcd801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39ca6bb749de04f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbcdfe00640 1 -- 172.21.15.16:0/1890792925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80a5840 con 0x7fbce01406e0 2024-04-26T22:21:42.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbcdfe00640 1 -- 172.21.15.16:0/1890792925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd80a59e0 con 0x7fbce01406e0 2024-04-26T22:21:42.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbcdfe00640 1 -- 172.21.15.16:0/1890792925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80a5db0 con 0x7fbce01406e0 2024-04-26T22:21:42.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 -- 172.21.15.16:0/1890792925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce01406e0 msgr2=0x7fbce0146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 --2- 172.21.15.16:0/1890792925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce01406e0 0x7fbce0146a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbce006ea30 tx=0x7fbcd801c960 comp rx=0 tx=0).stop 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 -- 172.21.15.16:0/1890792925 shutdown_connections 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 --2- 172.21.15.16:0/1890792925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce01406e0 0x7fbce0146a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 --2- 172.21.15.16:0/1890792925 >> v2:172.21.15.195:3300/0 conn(0x7fbce00b0a30 0x7fbce01464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 -- 172.21.15.16:0/1890792925 >> 172.21.15.16:0/1890792925 conn(0x7fbce00b6590 msgr2=0x7fbce00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 -- 172.21.15.16:0/1890792925 shutdown_connections 2024-04-26T22:21:42.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.495+0000 7fbce7600640 1 -- 172.21.15.16:0/1890792925 wait complete. 2024-04-26T22:21:42.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 Processor -- start 2024-04-26T22:21:42.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- start start 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbce006e410 0x7fbce0073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 0x7fbce01e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0153520 con 0x7fbce00b0a30 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbce01533a0 con 0x7fbce01406e0 2024-04-26T22:21:42.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbce01536a0 con 0x7fbce006e410 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41622/0 (socket says 172.21.15.16:41622) 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 -- 172.21.15.16:0/1528973027 learned_addr learned my addr 172.21.15.16:0/1528973027 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce4c00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbce006e410 0x7fbce0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce5600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 0x7fbce01e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 -- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbce006e410 msgr2=0x7fbce0073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbce006e410 0x7fbce0073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 -- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 msgr2=0x7fbce01e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 0x7fbce01e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 -- 172.21.15.16:0/1528973027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce00b83b0 con 0x7fbce00b0a30 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce5600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 0x7fbce01e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcd7e00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800d800 tx=0x7fbcc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800b6c0 con 0x7fbce00b0a30 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc8019070 con 0x7fbce00b0a30 2024-04-26T22:21:42.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800baa0 con 0x7fbce00b0a30 2024-04-26T22:21:42.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce0141f90 con 0x7fbce00b0a30 2024-04-26T22:21:42.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.499+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce0140b50 con 0x7fbce00b0a30 2024-04-26T22:21:42.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce0069530 con 0x7fbce00b0a30 2024-04-26T22:21:42.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbcc800bc40 con 0x7fbce00b0a30 2024-04-26T22:21:42.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbcdd600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 0x7fbcbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbcc8086e70 con 0x7fbce00b0a30 2024-04-26T22:21:42.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbce4c00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 0x7fbcbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.503+0000 7fbce4c00640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 0x7fbcbc06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0000f70 tx=0x7fbcd0007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.507+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbcc8057420 con 0x7fbce00b0a30 2024-04-26T22:21:42.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.671+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbce013e6a0 con 0x7fbce00b0a30 2024-04-26T22:21:42.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.671+0000 7fbcdd600640 1 -- 172.21.15.16:0/1528973027 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fbcc8056d20 con 0x7fbce00b0a30 2024-04-26T22:21:42.675 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 msgr2=0x7fbcbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 0x7fbcbc06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0000f70 tx=0x7fbcd0007cd0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 msgr2=0x7fbce0141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800d800 tx=0x7fbcc800dcc0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 shutdown_connections 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcbc068380 0x7fbcbc06a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbce01406e0 0x7fbce01e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce00b0a30 0x7fbce0141840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 --2- 172.21.15.16:0/1528973027 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbce006e410 0x7fbce0073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 >> 172.21.15.16:0/1528973027 conn(0x7fbce00b6590 msgr2=0x7fbce013ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 shutdown_connections 2024-04-26T22:21:42.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.675+0000 7fbce7600640 1 -- 172.21.15.16:0/1528973027 wait complete. 2024-04-26T22:21:42.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:42.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 Processor -- start 2024-04-26T22:21:42.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 -- start start 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdd100b0a30 0x7fdd101464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10070480 con 0x7fdd1006e410 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1006e7f0 con 0x7fdd101406e0 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd15200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdd10070a60 con 0x7fdd100b0a30 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0de00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdd1006e410 0x7fdd1013ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40958/0 (socket says 172.21.15.16:40958) 2024-04-26T22:21:42.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0de00640 1 -- 172.21.15.16:0/171677735 learned_addr learned my addr 172.21.15.16:0/171677735 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:42.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd05400640 1 --2- 172.21.15.16:0/171677735 >> v2:172.21.15.195:3300/0 conn(0x7fdd100b0a30 0x7fdd101464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810919051 0 0) 0x7fdd10070480 con 0x7fdd1006e410 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf4003530 con 0x7fdd1006e410 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139693906 0 0) 0x7fdd1006e7f0 con 0x7fdd101406e0 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd10070480 con 0x7fdd101406e0 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd05400640 1 -- 172.21.15.16:0/171677735 >> v1:172.21.15.195:6789/0 conn(0x7fdd101406e0 legacy=0x7fdd10150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd05400640 1 -- 172.21.15.16:0/171677735 >> v1:172.21.15.16:6789/0 conn(0x7fdd1006e410 legacy=0x7fdd1013ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.839+0000 7fdd05400640 1 -- 172.21.15.16:0/171677735 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd100706f0 con 0x7fdd100b0a30 2024-04-26T22:21:42.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd05400640 1 --2- 172.21.15.16:0/171677735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd101464e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097c0 tx=0x7fdcf801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f229dd966c81db8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80b0070 con 0x7fdd100b0a30 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf80ab600 con 0x7fdd100b0a30 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd0d400640 1 -- 172.21.15.16:0/171677735 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80ab9d0 con 0x7fdd100b0a30 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- 172.21.15.16:0/171677735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 msgr2=0x7fdd101464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 --2- 172.21.15.16:0/171677735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd101464e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097c0 tx=0x7fdcf801c410 comp rx=0 tx=0).stop 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- 172.21.15.16:0/171677735 shutdown_connections 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 --2- 172.21.15.16:0/171677735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd101464e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- 172.21.15.16:0/171677735 >> 172.21.15.16:0/171677735 conn(0x7fdd100b6590 msgr2=0x7fdd100b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- 172.21.15.16:0/171677735 shutdown_connections 2024-04-26T22:21:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- 172.21.15.16:0/171677735 wait complete. 2024-04-26T22:21:42.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 Processor -- start 2024-04-26T22:21:42.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.843+0000 7fdd15200640 1 -- start start 2024-04-26T22:21:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd10135020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd101406e0 0x7fdd101e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10154c40 con 0x7fdd1006e410 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10154ac0 con 0x7fdd100b0a30 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdd10154dc0 con 0x7fdd101406e0 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41626/0 (socket says 172.21.15.16:41626) 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 -- 172.21.15.16:0/3629062734 learned_addr learned my addr 172.21.15.16:0/3629062734 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd05400640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd10135020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0e800640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd101406e0 0x7fdd101e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 -- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd101406e0 msgr2=0x7fdd101e1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd101406e0 0x7fdd101e1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 -- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 msgr2=0x7fdd10135020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd10135020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 -- 172.21.15.16:0/3629062734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd10132fd0 con 0x7fdd1006e410 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd0de00640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000cc10 tx=0x7fdd0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00017070 con 0x7fdd1006e410 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0000ce20 con 0x7fdd1006e410 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd10132050 con 0x7fdd1006e410 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00012620 con 0x7fdd1006e410 2024-04-26T22:21:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd10132c30 con 0x7fdd1006e410 2024-04-26T22:21:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd10069530 con 0x7fdd1006e410 2024-04-26T22:21:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.847+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd0001a070 con 0x7fdd1006e410 2024-04-26T22:21:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.851+0000 7fdd06a00640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 0x7fdcec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.851+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdd00086920 con 0x7fdd1006e410 2024-04-26T22:21:42.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.851+0000 7fdd05400640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 0x7fdcec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:42.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.851+0000 7fdd05400640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 0x7fdcec06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80ad000 tx=0x7fdcf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:42.855+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdd00056e50 con 0x7fdd1006e410 2024-04-26T22:21:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdd10132220 con 0x7fdd1006e410 2024-04-26T22:21:43.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd06a00640 1 -- 172.21.15.16:0/3629062734 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fdd00056750 con 0x7fdd1006e410 2024-04-26T22:21:43.025 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 msgr2=0x7fdcec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 0x7fdcec06a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80ad000 tx=0x7fdcf8008040 comp rx=0 tx=0).stop 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 msgr2=0x7fdd10136de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000cc10 tx=0x7fdd0000a430 comp rx=0 tx=0).stop 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 shutdown_connections 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdcec068380 0x7fdcec06a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdd101406e0 0x7fdd101e1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd100b0a30 0x7fdd10135020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 --2- 172.21.15.16:0/3629062734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd1006e410 0x7fdd10136de0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 >> 172.21.15.16:0/3629062734 conn(0x7fdd100b6590 msgr2=0x7fdd1013a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 shutdown_connections 2024-04-26T22:21:43.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.023+0000 7fdd15200640 1 -- 172.21.15.16:0/3629062734 wait complete. 2024-04-26T22:21:43.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:43.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.183+0000 7ffad0c00640 1 Processor -- start 2024-04-26T22:21:43.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.183+0000 7ffad0c00640 1 -- start start 2024-04-26T22:21:43.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffacc073d90 0x7ffacc140170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b66c0 0x7ffacc1406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffacc0b6b80 con 0x7ffacc0b66c0 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ffacc14a210 con 0x7ffacc073d90 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffad0c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc0b8dd0 con 0x7ffacc0b8680 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b66c0 0x7ffacc1406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffacc0b66c0 0x7ffacc1406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41640/0 (socket says 172.21.15.16:41640) 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 -- 172.21.15.16:0/1841321486 learned_addr learned my addr 172.21.15.16:0/1841321486 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffac9e00640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffac3e00640 1 --2- 172.21.15.16:0/1841321486 >> v2:172.21.15.195:3300/0 conn(0x7ffacc073d90 0x7ffacc140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 -- 172.21.15.16:0/1841321486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 msgr2=0x7ffacc146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 -- 172.21.15.16:0/1841321486 >> v2:172.21.15.195:3300/0 conn(0x7ffacc073d90 msgr2=0x7ffacc140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:43.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 --2- 172.21.15.16:0/1841321486 >> v2:172.21.15.195:3300/0 conn(0x7ffacc073d90 0x7ffacc140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 -- 172.21.15.16:0/1841321486 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc149ea0 con 0x7ffacc0b66c0 2024-04-26T22:21:43.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.187+0000 7ffaca800640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b66c0 0x7ffacc1406b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b9160 tx=0x7ffac401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4317e5cf1f82a641 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9400640 1 -- 172.21.15.16:0/1841321486 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40a5600 con 0x7ffacc0b66c0 2024-04-26T22:21:43.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9400640 1 -- 172.21.15.16:0/1841321486 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac40a57a0 con 0x7ffacc0b66c0 2024-04-26T22:21:43.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9400640 1 -- 172.21.15.16:0/1841321486 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac40a5b70 con 0x7ffacc0b66c0 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- 172.21.15.16:0/1841321486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b66c0 msgr2=0x7ffacc1406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b66c0 0x7ffacc1406b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b9160 tx=0x7ffac401c960 comp rx=0 tx=0).stop 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- 172.21.15.16:0/1841321486 shutdown_connections 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc0b66c0 0x7ffacc1406b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- 172.21.15.16:0/1841321486 >> v2:172.21.15.195:3300/0 conn(0x7ffacc073d90 0x7ffacc140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- 172.21.15.16:0/1841321486 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- 172.21.15.16:0/1841321486 >> 172.21.15.16:0/1841321486 conn(0x7ffacc06f3d0 msgr2=0x7ffacc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- 172.21.15.16:0/1841321486 shutdown_connections 2024-04-26T22:21:43.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- 172.21.15.16:0/1841321486 wait complete. 2024-04-26T22:21:43.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 Processor -- start 2024-04-26T22:21:43.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- start start 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 0x7ffacc142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc13cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc146a40 con 0x7ffacc073d90 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc1468c0 con 0x7ffacc0b66c0 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffad0c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc072e20 con 0x7ffacc0b8680 2024-04-26T22:21:43.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41650/0 (socket says 172.21.15.16:41650) 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 -- 172.21.15.16:0/820357704 learned_addr learned my addr 172.21.15.16:0/820357704 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac3e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 0x7ffacc142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffaca800640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc13cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 -- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 msgr2=0x7ffacc13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc13cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 -- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 msgr2=0x7ffacc142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 0x7ffacc142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac9e00640 1 -- 172.21.15.16:0/820357704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc0ba7e0 con 0x7ffacc073d90 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.191+0000 7ffac3e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 0x7ffacc142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac9e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d620 tx=0x7ffabc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00b620 con 0x7ffacc073d90 2024-04-26T22:21:43.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc019070 con 0x7ffacc073d90 2024-04-26T22:21:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc143a40 con 0x7ffacc073d90 2024-04-26T22:21:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00b9e0 con 0x7ffacc073d90 2024-04-26T22:21:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1e47b0 con 0x7ffacc073d90 2024-04-26T22:21:43.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc069530 con 0x7ffacc073d90 2024-04-26T22:21:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffabc00bb80 con 0x7ffacc073d90 2024-04-26T22:21:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffabc086cf0 con 0x7ffacc073d90 2024-04-26T22:21:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.195+0000 7ffac3e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.199+0000 7ffac3e00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffacc13b2b0 tx=0x7ffab4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.199+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffacc143a40 con 0x7ffacc073d90 2024-04-26T22:21:43.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffacc0b16b0 con 0x7ffacc073d90 2024-04-26T22:21:43.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffac2000640 1 -- 172.21.15.16:0/820357704 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7ffabc0572a0 con 0x7ffacc073d90 2024-04-26T22:21:43.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:43.370 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 msgr2=0x7ffaa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffacc13b2b0 tx=0x7ffab4008040 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 msgr2=0x7ffacc1433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d620 tx=0x7ffabc00dae0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 shutdown_connections 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ffaa8068380 0x7ffaa806a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffacc0b8680 0x7ffacc13cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffacc0b66c0 0x7ffacc142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 --2- 172.21.15.16:0/820357704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffacc073d90 0x7ffacc1433e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 >> 172.21.15.16:0/820357704 conn(0x7ffacc06f3d0 msgr2=0x7ffacc0b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 shutdown_connections 2024-04-26T22:21:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.367+0000 7ffad0c00640 1 -- 172.21.15.16:0/820357704 wait complete. 2024-04-26T22:21:43.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:43.391 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:43.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 Processor -- start 2024-04-26T22:21:43.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 -- start start 2024-04-26T22:21:43.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8b006e410 0x7fc8b013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc8b0146bf0 0x7fc8b0140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b0070480 con 0x7fc8b00b0a30 2024-04-26T22:21:43.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b0070a60 con 0x7fc8b006e410 2024-04-26T22:21:43.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8b5a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b00718a0 con 0x7fc8b0146bf0 2024-04-26T22:21:43.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.531+0000 7fc8aea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8b006e410 0x7fc8b013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8b006e410 0x7fc8b013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41652/0 (socket says 172.21.15.16:41652) 2024-04-26T22:21:43.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 -- 172.21.15.16:0/1792315981 learned_addr learned my addr 172.21.15.16:0/1792315981 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:43.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8af400640 1 --2- 172.21.15.16:0/1792315981 >> v2:172.21.15.195:3300/0 conn(0x7fc8b0146bf0 0x7fc8b0140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 -- 172.21.15.16:0/1792315981 >> v2:172.21.15.195:3300/0 conn(0x7fc8b0146bf0 msgr2=0x7fc8b0140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:43.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 --2- 172.21.15.16:0/1792315981 >> v2:172.21.15.195:3300/0 conn(0x7fc8b0146bf0 0x7fc8b0140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 -- 172.21.15.16:0/1792315981 >> v1:172.21.15.195:6789/0 conn(0x7fc8b00b0a30 legacy=0x7fc8b01464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 -- 172.21.15.16:0/1792315981 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b006e7f0 con 0x7fc8b006e410 2024-04-26T22:21:43.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8aea00640 1 --2- 172.21.15.16:0/1792315981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b006e410 0x7fc8b013ffd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0146200 tx=0x7fc8a001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05f7faf99f51d75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8ae000640 1 -- 172.21.15.16:0/1792315981 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00ab680 con 0x7fc8b006e410 2024-04-26T22:21:43.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8ae000640 1 -- 172.21.15.16:0/1792315981 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a00b0070 con 0x7fc8b006e410 2024-04-26T22:21:43.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.535+0000 7fc8ae000640 1 -- 172.21.15.16:0/1792315981 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00aba40 con 0x7fc8b006e410 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/1792315981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b006e410 msgr2=0x7fc8b013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/1792315981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b006e410 0x7fc8b013ffd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0146200 tx=0x7fc8a001c460 comp rx=0 tx=0).stop 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/1792315981 shutdown_connections 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/1792315981 >> v2:172.21.15.195:3300/0 conn(0x7fc8b0146bf0 0x7fc8b0140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/1792315981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b006e410 0x7fc8b013ffd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/1792315981 >> 172.21.15.16:0/1792315981 conn(0x7fc8b00b6590 msgr2=0x7fc8b00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/1792315981 shutdown_connections 2024-04-26T22:21:43.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/1792315981 wait complete. 2024-04-26T22:21:43.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 Processor -- start 2024-04-26T22:21:43.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- start start 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b006e410 0x7fc8b01498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 0x7fc8b0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0153520 con 0x7fc8b00b0a30 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01533a0 con 0x7fc8b006e410 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b01536a0 con 0x7fc8b0146bf0 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41662/0 (socket says 172.21.15.16:41662) 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 -- 172.21.15.16:0/943560519 learned_addr learned my addr 172.21.15.16:0/943560519 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8aea00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b006e410 0x7fc8b01498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8af400640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 0x7fc8b0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 -- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 msgr2=0x7fc8b0147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 0x7fc8b0147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 -- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b006e410 msgr2=0x7fc8b01498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b006e410 0x7fc8b01498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 -- 172.21.15.16:0/943560519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b0073ed0 con 0x7fc8b00b0a30 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8af400640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 0x7fc8b0147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a7e00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c460 tx=0x7fc89800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898016020 con 0x7fc8b00b0a30 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8980052d0 con 0x7fc8b00b0a30 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898007260 con 0x7fc8b00b0a30 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.539+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b0072350 con 0x7fc8b00b0a30 2024-04-26T22:21:43.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b014a400 con 0x7fc8b00b0a30 2024-04-26T22:21:43.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b0069530 con 0x7fc8b00b0a30 2024-04-26T22:21:43.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc898007400 con 0x7fc8b00b0a30 2024-04-26T22:21:43.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8a6a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 0x7fc88c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc8980862c0 con 0x7fc8b00b0a30 2024-04-26T22:21:43.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.543+0000 7fc8aea00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 0x7fc88c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.547+0000 7fc8aea00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 0x7fc88c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00af000 tx=0x7fc8a00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.547+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc898020020 con 0x7fc8b00b0a30 2024-04-26T22:21:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8b013dea0 con 0x7fc8b00b0a30 2024-04-26T22:21:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8a6a00640 1 -- 172.21.15.16:0/943560519 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc898005480 con 0x7fc8b00b0a30 2024-04-26T22:21:43.717 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:43.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 msgr2=0x7fc88c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 0x7fc88c06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00af000 tx=0x7fc8a00a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:43.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 msgr2=0x7fc8b0147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c460 tx=0x7fc89800c920 comp rx=0 tx=0).stop 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 shutdown_connections 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc88c068380 0x7fc88c06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc8b0146bf0 0x7fc8b0147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8b00b0a30 0x7fc8b0147710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 --2- 172.21.15.16:0/943560519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8b006e410 0x7fc8b01498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 >> 172.21.15.16:0/943560519 conn(0x7fc8b00b6590 msgr2=0x7fc8b014ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 shutdown_connections 2024-04-26T22:21:43.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.715+0000 7fc8b5a00640 1 -- 172.21.15.16:0/943560519 wait complete. 2024-04-26T22:21:43.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 Processor -- start 2024-04-26T22:21:43.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 -- start start 2024-04-26T22:21:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1bd413eec0 0x7f1bd413f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd413f870 con 0x7f1bd41465c0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd4070a40 con 0x7f1bd413eec0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd9e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd406e7f0 con 0x7f1bd406e410 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd2000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1bd41465c0 0x7f1bd4149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40970/0 (socket says 172.21.15.16:40970) 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd2000640 1 -- 172.21.15.16:0/2877299992 learned_addr learned my addr 172.21.15.16:0/2877299992 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd3400640 1 --2- 172.21.15.16:0/2877299992 >> v2:172.21.15.16:3300/0 conn(0x7f1bd413eec0 0x7f1bd413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd2a00640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd1600640 1 -- 172.21.15.16:0/2877299992 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145239941 0 0) 0x7f1bd413f870 con 0x7f1bd41465c0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd1600640 1 -- 172.21.15.16:0/2877299992 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb8003530 con 0x7f1bd41465c0 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd3400640 1 -- 172.21.15.16:0/2877299992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 msgr2=0x7f1bd40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd3400640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd40b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd3400640 1 -- 172.21.15.16:0/2877299992 >> v1:172.21.15.16:6789/0 conn(0x7f1bd41465c0 legacy=0x7f1bd4149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.883+0000 7f1bd3400640 1 -- 172.21.15.16:0/2877299992 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd4070760 con 0x7f1bd413eec0 2024-04-26T22:21:43.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd3400640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd413eec0 0x7f1bd413f330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45187e878209c92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd1600640 1 -- 172.21.15.16:0/2877299992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b2070 con 0x7f1bd413eec0 2024-04-26T22:21:43.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd1600640 1 -- 172.21.15.16:0/2877299992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0a5890 con 0x7f1bd413eec0 2024-04-26T22:21:43.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd1600640 1 -- 172.21.15.16:0/2877299992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0a5c60 con 0x7f1bd413eec0 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- 172.21.15.16:0/2877299992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd413eec0 msgr2=0x7f1bd413f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd413eec0 0x7f1bd413f330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc01c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- 172.21.15.16:0/2877299992 shutdown_connections 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd413eec0 0x7f1bd413f330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/2877299992 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd40b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- 172.21.15.16:0/2877299992 >> 172.21.15.16:0/2877299992 conn(0x7f1bd40b6590 msgr2=0x7f1bd40b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- 172.21.15.16:0/2877299992 shutdown_connections 2024-04-26T22:21:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- 172.21.15.16:0/2877299992 wait complete. 2024-04-26T22:21:43.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 Processor -- start 2024-04-26T22:21:43.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.887+0000 7f1bd9e00640 1 -- start start 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd413b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 0x7f1bd41de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4152600 con 0x7f1bd41465c0 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4152480 con 0x7f1bd413eec0 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd4152780 con 0x7f1bd406e410 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41680/0 (socket says 172.21.15.16:41680) 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 -- 172.21.15.16:0/460690955 learned_addr learned my addr 172.21.15.16:0/460690955 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd2a00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd413b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd2000640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 0x7f1bd41de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 -- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 msgr2=0x7f1bd413b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd413b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 -- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 msgr2=0x7f1bd41de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:43.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 0x7f1bd41de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:43.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 -- 172.21.15.16:0/460690955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd4071930 con 0x7f1bd41465c0 2024-04-26T22:21:43.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd2000640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 0x7f1bd41de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:43.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd3400640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b0040 tx=0x7f1bcc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b2050 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0be070 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd40720c0 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0ad870 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd4072360 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd4069530 con 0x7f1bd41465c0 2024-04-26T22:21:43.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.891+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bcc0ada10 con 0x7f1bd41465c0 2024-04-26T22:21:43.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.895+0000 7f1bcb400640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 0x7f1bb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:43.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.895+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1bcc121b00 con 0x7f1bd41465c0 2024-04-26T22:21:43.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.895+0000 7f1bd2a00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 0x7f1bb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:43.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.895+0000 7f1bd2a00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 0x7f1bb406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009b60 tx=0x7f1bc4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:43.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:43.899+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1bcc016560 con 0x7f1bd41465c0 2024-04-26T22:21:44.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.063+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1bd40b8380 con 0x7f1bd41465c0 2024-04-26T22:21:44.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.063+0000 7f1bcb400640 1 -- 172.21.15.16:0/460690955 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f1bcc0add00 con 0x7f1bd41465c0 2024-04-26T22:21:44.066 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:44.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 msgr2=0x7f1bb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 0x7f1bb406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009b60 tx=0x7f1bc4009190 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 msgr2=0x7f1bd4073490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0b0040 tx=0x7f1bcc019680 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 shutdown_connections 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1bb40683b0 0x7f1bb406a870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bd41465c0 0x7f1bd4073490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1bd413eec0 0x7f1bd41de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 --2- 172.21.15.16:0/460690955 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1bd406e410 0x7f1bd413b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 >> 172.21.15.16:0/460690955 conn(0x7f1bd40b6590 msgr2=0x7f1bd40b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 shutdown_connections 2024-04-26T22:21:44.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.067+0000 7f1bd9e00640 1 -- 172.21.15.16:0/460690955 wait complete. 2024-04-26T22:21:44.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:44.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 Processor -- start 2024-04-26T22:21:44.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 -- start start 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb644073d20 0x7fb64406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6440b6df0 con 0x7fb6440b8680 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6440b6b10 con 0x7fb64406e110 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb64a000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb64406d490 con 0x7fb644073d20 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb648c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb6440b8680 0x7fb644142330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:40986/0 (socket says 172.21.15.16:40986) 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb648c00640 1 -- 172.21.15.16:0/3934367154 learned_addr learned my addr 172.21.15.16:0/3934367154 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:44.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb649600640 1 --2- 172.21.15.16:0/3934367154 >> v2:172.21.15.16:3300/0 conn(0x7fb644073d20 0x7fb64406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb643400640 1 -- 172.21.15.16:0/3934367154 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319976709 0 0) 0x7fb6440b6df0 con 0x7fb6440b8680 2024-04-26T22:21:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb643400640 1 -- 172.21.15.16:0/3934367154 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb62c003530 con 0x7fb6440b8680 2024-04-26T22:21:44.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb649600640 1 -- 172.21.15.16:0/3934367154 >> v1:172.21.15.195:6789/0 conn(0x7fb64406e110 legacy=0x7fb644150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb649600640 1 -- 172.21.15.16:0/3934367154 >> v1:172.21.15.16:6789/0 conn(0x7fb6440b8680 legacy=0x7fb644142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.231+0000 7fb649600640 1 -- 172.21.15.16:0/3934367154 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6440b2ce0 con 0x7fb644073d20 2024-04-26T22:21:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb649600640 1 --2- 172.21.15.16:0/3934367154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb644073d20 0x7fb64406d9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbfdf80c8d80ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb643400640 1 -- 172.21.15.16:0/3934367154 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b2070 con 0x7fb644073d20 2024-04-26T22:21:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb643400640 1 -- 172.21.15.16:0/3934367154 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0a5a10 con 0x7fb644073d20 2024-04-26T22:21:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb643400640 1 -- 172.21.15.16:0/3934367154 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a5de0 con 0x7fb644073d20 2024-04-26T22:21:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- 172.21.15.16:0/3934367154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb644073d20 msgr2=0x7fb64406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 --2- 172.21.15.16:0/3934367154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb644073d20 0x7fb64406d9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c01c970 comp rx=0 tx=0).stop 2024-04-26T22:21:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- 172.21.15.16:0/3934367154 shutdown_connections 2024-04-26T22:21:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 --2- 172.21.15.16:0/3934367154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb644073d20 0x7fb64406d9b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- 172.21.15.16:0/3934367154 >> 172.21.15.16:0/3934367154 conn(0x7fb644068140 msgr2=0x7fb644068550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- 172.21.15.16:0/3934367154 shutdown_connections 2024-04-26T22:21:44.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- 172.21.15.16:0/3934367154 wait complete. 2024-04-26T22:21:44.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 Processor -- start 2024-04-26T22:21:44.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.235+0000 7fb64a000640 1 -- start start 2024-04-26T22:21:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb64406e110 0x7fb644137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb644073d20 0x7fb6441e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb644156e00 con 0x7fb6440b8680 2024-04-26T22:21:44.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb644156c80 con 0x7fb64406e110 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb644156f80 con 0x7fb644073d20 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41694/0 (socket says 172.21.15.16:41694) 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 -- 172.21.15.16:0/3741965909 learned_addr learned my addr 172.21.15.16:0/3741965909 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb648c00640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb64406e110 0x7fb644137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb643e00640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb644073d20 0x7fb6441e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 -- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb644073d20 msgr2=0x7fb6441e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb644073d20 0x7fb6441e42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 -- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb64406e110 msgr2=0x7fb644137640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb64406e110 0x7fb644137640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 -- 172.21.15.16:0/3741965909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb644146290 con 0x7fb6440b8680 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb649600640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0b0040 tx=0x7fb63c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b2050 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c0b3040 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ad890 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6440baf00 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb644146530 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb644069450 con 0x7fb6440b8680 2024-04-26T22:21:44.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.239+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb63c0c0020 con 0x7fb6440b8680 2024-04-26T22:21:44.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.243+0000 7fb640c00640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 0x7fb62406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.243+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb63c121130 con 0x7fb6440b8680 2024-04-26T22:21:44.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.243+0000 7fb648c00640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 0x7fb62406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.243+0000 7fb648c00640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 0x7fb62406a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6380011f0 tx=0x7fb638009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.247+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb63c0c7020 con 0x7fb6440b8680 2024-04-26T22:21:44.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.415+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb644069c80 con 0x7fb6440b8680 2024-04-26T22:21:44.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.415+0000 7fb640c00640 1 -- 172.21.15.16:0/3741965909 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fb63c016560 con 0x7fb6440b8680 2024-04-26T22:21:44.419 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 msgr2=0x7fb62406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 0x7fb62406a870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6380011f0 tx=0x7fb638009040 comp rx=0 tx=0).stop 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 msgr2=0x7fb6441e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0b0040 tx=0x7fb63c019710 comp rx=0 tx=0).stop 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 shutdown_connections 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6240683b0 0x7fb62406a870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6440b8680 0x7fb6441e4830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb644073d20 0x7fb6441e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 --2- 172.21.15.16:0/3741965909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb64406e110 0x7fb644137640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 >> 172.21.15.16:0/3741965909 conn(0x7fb644068140 msgr2=0x7fb6441403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 shutdown_connections 2024-04-26T22:21:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.419+0000 7fb64a000640 1 -- 172.21.15.16:0/3741965909 wait complete. 2024-04-26T22:21:44.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:44.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:21:44.533 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.579+0000 7f0dea000640 1 Processor -- start 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.579+0000 7f0dea000640 1 -- start start 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0dea000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0de406e450 0x7f0de40b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0dea000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0de414dac0 0x7f0de414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0dea000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de406e830 con 0x7f0de413ef30 2024-04-26T22:21:44.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0dea000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0de40b0d10 con 0x7f0de414dac0 2024-04-26T22:21:44.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0dea000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0de40b0a30 con 0x7f0de406e450 2024-04-26T22:21:44.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0de414dac0 0x7f0de414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0de414dac0 0x7f0de414feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56424/0 (socket says 172.21.15.16:56424) 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 -- 172.21.15.16:0/354055421 learned_addr learned my addr 172.21.15.16:0/354055421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3400640 1 --2- 172.21.15.16:0/354055421 >> v2:172.21.15.195:3300/0 conn(0x7f0de406e450 0x7f0de40b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 -- 172.21.15.16:0/354055421 >> v2:172.21.15.195:3300/0 conn(0x7f0de406e450 msgr2=0x7f0de40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 --2- 172.21.15.16:0/354055421 >> v2:172.21.15.195:3300/0 conn(0x7f0de406e450 0x7f0de40b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 -- 172.21.15.16:0/354055421 >> v1:172.21.15.195:6789/0 conn(0x7f0de413ef30 legacy=0x7f0de413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:44.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.583+0000 7f0de3e00640 1 -- 172.21.15.16:0/354055421 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de40b2cf0 con 0x7f0de414dac0 2024-04-26T22:21:44.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0de3e00640 1 --2- 172.21.15.16:0/354055421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de414dac0 0x7f0de414feb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0de40b0e90 tx=0x7f0ddc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8882ed4e75742a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0de2a00640 1 -- 172.21.15.16:0/354055421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0a5640 con 0x7f0de414dac0 2024-04-26T22:21:44.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0de2a00640 1 -- 172.21.15.16:0/354055421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc0a57e0 con 0x7f0de414dac0 2024-04-26T22:21:44.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0de2a00640 1 -- 172.21.15.16:0/354055421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0a5bb0 con 0x7f0de414dac0 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- 172.21.15.16:0/354055421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de414dac0 msgr2=0x7f0de414feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- 172.21.15.16:0/354055421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de414dac0 0x7f0de414feb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0de40b0e90 tx=0x7f0ddc01c890 comp rx=0 tx=0).stop 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- 172.21.15.16:0/354055421 shutdown_connections 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- 172.21.15.16:0/354055421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de414dac0 0x7f0de414feb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- 172.21.15.16:0/354055421 >> v2:172.21.15.195:3300/0 conn(0x7f0de406e450 0x7f0de40b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- 172.21.15.16:0/354055421 >> 172.21.15.16:0/354055421 conn(0x7f0de40b6620 msgr2=0x7f0de40b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- 172.21.15.16:0/354055421 shutdown_connections 2024-04-26T22:21:44.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- 172.21.15.16:0/354055421 wait complete. 2024-04-26T22:21:44.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 Processor -- start 2024-04-26T22:21:44.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- start start 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0de413ef30 0x7f0de4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0de414dac0 0x7f0de41e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0de40b63e0 con 0x7f0de406e450 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0de40b6260 con 0x7f0de413ef30 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.587+0000 7f0dea000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0de40b2830 con 0x7f0de414dac0 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56436/0 (socket says 172.21.15.16:56436) 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 -- 172.21.15.16:0/281358437 learned_addr learned my addr 172.21.15.16:0/281358437 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3e00640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0de414dac0 0x7f0de41e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddbe00640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0de413ef30 0x7f0de4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 -- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0de414dac0 msgr2=0x7f0de41e1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0de414dac0 0x7f0de41e1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 -- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0de413ef30 msgr2=0x7f0de4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0de413ef30 0x7f0de4071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 -- 172.21.15.16:0/281358437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de4142e90 con 0x7f0de406e450 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0de3400640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d620 tx=0x7f0dd400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400b620 con 0x7f0de406e450 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd4019070 con 0x7f0de406e450 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400b9e0 con 0x7f0de406e450 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de4072530 con 0x7f0de406e450 2024-04-26T22:21:44.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de4141cd0 con 0x7f0de406e450 2024-04-26T22:21:44.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de4069530 con 0x7f0de406e450 2024-04-26T22:21:44.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0dd400bb80 con 0x7f0de406e450 2024-04-26T22:21:44.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 0x7f0dc006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.591+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0dd4086c50 con 0x7f0de406e450 2024-04-26T22:21:44.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.595+0000 7f0ddbe00640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 0x7f0dc006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.595+0000 7f0ddbe00640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 0x7f0dc006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0de413a790 tx=0x7f0dcc007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.599+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0dd4056bb0 con 0x7f0de406e450 2024-04-26T22:21:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.767+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0de4141a70 con 0x7f0de406e450 2024-04-26T22:21:44.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.767+0000 7f0ddb400640 1 -- 172.21.15.16:0/281358437 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f0dd405aeb0 con 0x7f0de406e450 2024-04-26T22:21:44.770 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:44.770 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 msgr2=0x7f0dc006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 0x7f0dc006a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0de413a790 tx=0x7f0dcc007e40 comp rx=0 tx=0).stop 2024-04-26T22:21:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 msgr2=0x7f0de4141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d620 tx=0x7f0dd400dae0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 shutdown_connections 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0dc0068380 0x7f0dc006a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0de414dac0 0x7f0de41e1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0de413ef30 0x7f0de4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 --2- 172.21.15.16:0/281358437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0de406e450 0x7f0de4141530 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 >> 172.21.15.16:0/281358437 conn(0x7f0de40b6620 msgr2=0x7f0de40b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 shutdown_connections 2024-04-26T22:21:44.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.771+0000 7f0dea000640 1 -- 172.21.15.16:0/281358437 wait complete. 2024-04-26T22:21:44.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:44.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:44.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 Processor -- start 2024-04-26T22:21:44.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 -- start start 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f86340b0a30 0x7f86341464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8634070480 con 0x7f86341406e0 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863406e7f0 con 0x7f863406e410 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f863b800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8634070a60 con 0x7f86340b0a30 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f8639800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f86341406e0 0x7f8634150b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36286/0 (socket says 172.21.15.16:36286) 2024-04-26T22:21:44.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f8639800640 1 -- 172.21.15.16:0/3898364241 learned_addr learned my addr 172.21.15.16:0/3898364241 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f862be00640 1 --2- 172.21.15.16:0/3898364241 >> v2:172.21.15.195:3300/0 conn(0x7f86340b0a30 0x7f86341464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f8633e00640 1 -- 172.21.15.16:0/3898364241 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800803204 0 0) 0x7f8634070480 con 0x7f86341406e0 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f8633e00640 1 -- 172.21.15.16:0/3898364241 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8618003530 con 0x7f86341406e0 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f862be00640 1 -- 172.21.15.16:0/3898364241 >> v1:172.21.15.195:6789/0 conn(0x7f863406e410 legacy=0x7f863413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.975+0000 7f862be00640 1 -- 172.21.15.16:0/3898364241 >> v1:172.21.15.16:6789/0 conn(0x7f86341406e0 legacy=0x7f8634150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f862be00640 1 -- 172.21.15.16:0/3898364241 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86340706f0 con 0x7f86340b0a30 2024-04-26T22:21:44.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f862be00640 1 --2- 172.21.15.16:0/3898364241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341464e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f861c0097c0 tx=0x7f861c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3436101341db58fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f8633e00640 1 -- 172.21.15.16:0/3898364241 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c0b0070 con 0x7f86340b0a30 2024-04-26T22:21:44.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f8633e00640 1 -- 172.21.15.16:0/3898364241 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c0ab600 con 0x7f86340b0a30 2024-04-26T22:21:44.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f8633e00640 1 -- 172.21.15.16:0/3898364241 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c0ab9d0 con 0x7f86340b0a30 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 -- 172.21.15.16:0/3898364241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 msgr2=0x7f86341464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 --2- 172.21.15.16:0/3898364241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341464e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f861c0097c0 tx=0x7f861c01c410 comp rx=0 tx=0).stop 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 -- 172.21.15.16:0/3898364241 shutdown_connections 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 --2- 172.21.15.16:0/3898364241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341464e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 -- 172.21.15.16:0/3898364241 >> 172.21.15.16:0/3898364241 conn(0x7f86340b6590 msgr2=0x7f86340b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 -- 172.21.15.16:0/3898364241 shutdown_connections 2024-04-26T22:21:44.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.979+0000 7f863b800640 1 -- 172.21.15.16:0/3898364241 wait complete. 2024-04-26T22:21:44.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 Processor -- start 2024-04-26T22:21:44.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- start start 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863406e410 0x7f8634143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8634154c40 con 0x7f86341406e0 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8634154ac0 con 0x7f86340b0a30 2024-04-26T22:21:44.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8634154dc0 con 0x7f863406e410 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8638e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863406e410 0x7f8634143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56448/0 (socket says 172.21.15.16:56448) 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 -- 172.21.15.16:0/2287422082 learned_addr learned my addr 172.21.15.16:0/2287422082 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f862be00640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 -- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863406e410 msgr2=0x7f8634143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863406e410 0x7f8634143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 -- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 msgr2=0x7f86341e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 -- 172.21.15.16:0/2287422082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8634143590 con 0x7f86341406e0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8639800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f862c00cad0 tx=0x7f862c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c017070 con 0x7f86341406e0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c00ac30 con 0x7f86341406e0 2024-04-26T22:21:44.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c012400 con 0x7f86341406e0 2024-04-26T22:21:44.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86340b2ab0 con 0x7f86341406e0 2024-04-26T22:21:44.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.983+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8634143af0 con 0x7f86341406e0 2024-04-26T22:21:44.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8634069530 con 0x7f86341406e0 2024-04-26T22:21:44.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f862c01a070 con 0x7f86341406e0 2024-04-26T22:21:44.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f8631600640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 0x7f861006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:44.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f862c0865f0 con 0x7f86341406e0 2024-04-26T22:21:44.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f8638e00640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 0x7f861006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:44.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.987+0000 7f8638e00640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 0x7f861006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f86340b2dd0 tx=0x7f8624009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:44.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:44.991+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8634143590 con 0x7f86341406e0 2024-04-26T22:21:45.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.155+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8634144e20 con 0x7f86341406e0 2024-04-26T22:21:45.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.155+0000 7f8631600640 1 -- 172.21.15.16:0/2287422082 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f862c0565f0 con 0x7f86341406e0 2024-04-26T22:21:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 msgr2=0x7f861006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 0x7f861006a870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f86340b2dd0 tx=0x7f8624009040 comp rx=0 tx=0).stop 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 msgr2=0x7f863413bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f862c00cad0 tx=0x7f862c00cf90 comp rx=0 tx=0).stop 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 shutdown_connections 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f86100683b0 0x7f861006a870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86341406e0 0x7f863413bbf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86340b0a30 0x7f86341e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 --2- 172.21.15.16:0/2287422082 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f863406e410 0x7f8634143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 >> 172.21.15.16:0/2287422082 conn(0x7f86340b6590 msgr2=0x7f86340aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 shutdown_connections 2024-04-26T22:21:45.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.159+0000 7f863b800640 1 -- 172.21.15.16:0/2287422082 wait complete. 2024-04-26T22:21:45.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:45.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 Processor -- start 2024-04-26T22:21:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 -- start start 2024-04-26T22:21:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e9c06e410 0x7f7e9c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9c06e7f0 con 0x7f7e9c1465c0 2024-04-26T22:21:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9c070760 con 0x7f7e9c13eec0 2024-04-26T22:21:45.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7ea0c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9c070a40 con 0x7f7e9c06e410 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e9c06e410 0x7f7e9c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e9c06e410 0x7f7e9c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56456/0 (socket says 172.21.15.16:56456) 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 -- 172.21.15.16:0/1266785094 learned_addr learned my addr 172.21.15.16:0/1266785094 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e91400640 1 --1- 172.21.15.16:0/1266785094 >> v1:172.21.15.16:6789/0 conn(0x7f7e9c1465c0 0x7f7e9c149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36288/0 (socket says 172.21.15.16:36288) 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 -- 172.21.15.16:0/1266785094 >> v1:172.21.15.195:6789/0 conn(0x7f7e9c13eec0 legacy=0x7f7e9c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 -- 172.21.15.16:0/1266785094 >> v1:172.21.15.16:6789/0 conn(0x7f7e9c1465c0 legacy=0x7f7e9c149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.323+0000 7f7e99e00640 1 -- 172.21.15.16:0/1266785094 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c148860 con 0x7f7e9c06e410 2024-04-26T22:21:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7e99e00640 1 --2- 172.21.15.16:0/1266785094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0b30d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009870 tx=0x7f7e8c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5e159bd8427870 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7e99400640 1 -- 172.21.15.16:0/1266785094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b0070 con 0x7f7e9c06e410 2024-04-26T22:21:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7e99400640 1 -- 172.21.15.16:0/1266785094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0ab600 con 0x7f7e9c06e410 2024-04-26T22:21:45.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7e99400640 1 -- 172.21.15.16:0/1266785094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ab9d0 con 0x7f7e9c06e410 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1266785094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 msgr2=0x7f7e9c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1266785094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0b30d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009870 tx=0x7f7e8c01c490 comp rx=0 tx=0).stop 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1266785094 shutdown_connections 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1266785094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0b30d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1266785094 >> 172.21.15.16:0/1266785094 conn(0x7f7e9c0b6590 msgr2=0x7f7e9c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:45.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1266785094 shutdown_connections 2024-04-26T22:21:45.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1266785094 wait complete. 2024-04-26T22:21:45.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 Processor -- start 2024-04-26T22:21:45.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.327+0000 7f7ea0c00640 1 -- start start 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e9c13eec0 0x7f7e9c1e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 0x7f7e9c134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c0b5070 con 0x7f7e9c06e410 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c0b4ef0 con 0x7f7e9c1465c0 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c0b51f0 con 0x7f7e9c13eec0 2024-04-26T22:21:45.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56458/0 (socket says 172.21.15.16:56458) 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 -- 172.21.15.16:0/1564853469 learned_addr learned my addr 172.21.15.16:0/1564853469 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e9a800640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 0x7f7e9c134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e91400640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e9c13eec0 0x7f7e9c1e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 -- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e9c13eec0 msgr2=0x7f7e9c1e44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e9c13eec0 0x7f7e9c1e44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 -- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 msgr2=0x7f7e9c134c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 0x7f7e9c134c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 -- 172.21.15.16:0/1564853469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c143ee0 con 0x7f7e9c06e410 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e9a800640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 0x7f7e9c134c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:45.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e99e00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ae040 tx=0x7f7e8c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ba020 con 0x7f7e9c06e410 2024-04-26T22:21:45.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0aa7d0 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b0040 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c1450a0 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c1e4a10 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.331+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9c1440b0 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.335+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e8c0bd020 con 0x7f7e9c06e410 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.335+0000 7f7e92a00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 0x7f7e7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.335+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7e8c120d90 con 0x7f7e9c06e410 2024-04-26T22:21:45.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.335+0000 7f7e91400640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 0x7f7e7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.335+0000 7f7e91400640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 0x7f7e7806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c1e2090 tx=0x7f7e84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.339+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e9c1440b0 con 0x7f7e9c06e410 2024-04-26T22:21:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.503+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7e9c144e90 con 0x7f7e9c06e410 2024-04-26T22:21:45.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.503+0000 7f7e92a00640 1 -- 172.21.15.16:0/1564853469 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f7e8c0c4030 con 0x7f7e9c06e410 2024-04-26T22:21:45.506 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 msgr2=0x7f7e7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 0x7f7e7806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c1e2090 tx=0x7f7e84009040 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 msgr2=0x7f7e9c0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0ae040 tx=0x7f7e8c01acd0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 shutdown_connections 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e78068380 0x7f7e7806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e9c1465c0 0x7f7e9c134c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e9c13eec0 0x7f7e9c1e44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 --2- 172.21.15.16:0/1564853469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e9c06e410 0x7f7e9c0af5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 >> 172.21.15.16:0/1564853469 conn(0x7f7e9c0b6590 msgr2=0x7f7e9c136c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 shutdown_connections 2024-04-26T22:21:45.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.507+0000 7f7ea0c00640 1 -- 172.21.15.16:0/1564853469 wait complete. 2024-04-26T22:21:45.528 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:45.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 Processor -- start 2024-04-26T22:21:45.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 -- start start 2024-04-26T22:21:45.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 0x7fe46c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe46c13eec0 0x7fe46c13f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe46c13f870 con 0x7fe46c1465c0 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe46c070a40 con 0x7fe46c13eec0 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.667+0000 7fe472800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe46c06e7f0 con 0x7fe46c06e410 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe46c13eec0 0x7fe46c13f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe46c13eec0 0x7fe46c13f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56464/0 (socket says 172.21.15.16:56464) 2024-04-26T22:21:45.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 -- 172.21.15.16:0/3394036997 learned_addr learned my addr 172.21.15.16:0/3394036997 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 -- 172.21.15.16:0/3394036997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 msgr2=0x7fe46c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46b400640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 0x7fe46c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 0x7fe46c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 -- 172.21.15.16:0/3394036997 >> v1:172.21.15.195:6789/0 conn(0x7fe46c1465c0 legacy=0x7fe46c149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 -- 172.21.15.16:0/3394036997 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c070760 con 0x7fe46c13eec0 2024-04-26T22:21:45.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46b400640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 0x7fe46c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:45.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46be00640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c13eec0 0x7fe46c13f330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe464009e50 tx=0x7fe46401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436e312a6103ffe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46aa00640 1 -- 172.21.15.16:0/3394036997 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4640a5750 con 0x7fe46c13eec0 2024-04-26T22:21:45.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46aa00640 1 -- 172.21.15.16:0/3394036997 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4640a58f0 con 0x7fe46c13eec0 2024-04-26T22:21:45.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.671+0000 7fe46aa00640 1 -- 172.21.15.16:0/3394036997 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4640a5cc0 con 0x7fe46c13eec0 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/3394036997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c13eec0 msgr2=0x7fe46c13f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c13eec0 0x7fe46c13f330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe464009e50 tx=0x7fe46401c9a0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/3394036997 shutdown_connections 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c13eec0 0x7fe46c13f330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- 172.21.15.16:0/3394036997 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c06e410 0x7fe46c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/3394036997 >> 172.21.15.16:0/3394036997 conn(0x7fe46c0b6590 msgr2=0x7fe46c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:45.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/3394036997 shutdown_connections 2024-04-26T22:21:45.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/3394036997 wait complete. 2024-04-26T22:21:45.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 Processor -- start 2024-04-26T22:21:45.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- start start 2024-04-26T22:21:45.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c13eec0 0x7fe46c1e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c1465c0 0x7fe46c1e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c152600 con 0x7fe46c06e410 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe46c152480 con 0x7fe46c13eec0 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe46c152780 con 0x7fe46c1465c0 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56476/0 (socket says 172.21.15.16:56476) 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 -- 172.21.15.16:0/2847495010 learned_addr learned my addr 172.21.15.16:0/2847495010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe463e00640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c13eec0 0x7fe46c1e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46be00640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c1465c0 0x7fe46c1e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 -- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c1465c0 msgr2=0x7fe46c1e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c1465c0 0x7fe46c1e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 -- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c13eec0 msgr2=0x7fe46c1e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c13eec0 0x7fe46c1e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 -- 172.21.15.16:0/2847495010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46c0b9390 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe46b400640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c7f0 tx=0x7fe45c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c015070 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c007820 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.675+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46c13d450 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c007c10 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46c0b21a0 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46c0b24b0 con 0x7fe46c06e410 2024-04-26T22:21:45.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe45c018070 con 0x7fe46c06e410 2024-04-26T22:21:45.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463400640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 0x7fe44806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:45.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe45c086b20 con 0x7fe46c06e410 2024-04-26T22:21:45.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463e00640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 0x7fe44806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:45.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.679+0000 7fe463e00640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 0x7fe44806a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46c1476d0 tx=0x7fe454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:45.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.683+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe45c0570d0 con 0x7fe46c06e410 2024-04-26T22:21:45.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.847+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe46c069f20 con 0x7fe46c06e410 2024-04-26T22:21:45.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.847+0000 7fe463400640 1 -- 172.21.15.16:0/2847495010 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fe45c0569d0 con 0x7fe46c06e410 2024-04-26T22:21:45.851 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:45.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 msgr2=0x7fe44806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 0x7fe44806a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46c1476d0 tx=0x7fe454009040 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 msgr2=0x7fe46c0b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c7f0 tx=0x7fe45c00ccb0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 shutdown_connections 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe448068380 0x7fe44806a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe46c1465c0 0x7fe46c1e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe46c13eec0 0x7fe46c1e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 --2- 172.21.15.16:0/2847495010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe46c06e410 0x7fe46c0b8b40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 >> 172.21.15.16:0/2847495010 conn(0x7fe46c0b6590 msgr2=0x7fe46c14dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 shutdown_connections 2024-04-26T22:21:45.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:45.851+0000 7fe472800640 1 -- 172.21.15.16:0/2847495010 wait complete. 2024-04-26T22:21:45.895 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-04-26T22:21:45.895 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-26T22:21:45.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:46.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.031+0000 7fb210000640 1 Processor -- start 2024-04-26T22:21:46.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.031+0000 7fb210000640 1 -- start start 2024-04-26T22:21:46.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb210000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2080a07d0 0x7fb208073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb210000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 0x7fb208152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb210000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080700f0 con 0x7fb2080a0bb0 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb210000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb208070420 con 0x7fb2080a07d0 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb210000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb208149330 con 0x7fb2081489c0 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2080a07d0 0x7fb208073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2080a07d0 0x7fb208073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56486/0 (socket says 172.21.15.16:56486) 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 -- 172.21.15.16:0/1843595649 learned_addr learned my addr 172.21.15.16:0/1843595649 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20cc00640 1 --1- 172.21.15.16:0/1843595649 >> v1:172.21.15.16:6789/0 conn(0x7fb2080a0bb0 0x7fb2080708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36302/0 (socket says 172.21.15.16:36302) 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20e000640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 0x7fb208152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 -- 172.21.15.16:0/1843595649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 msgr2=0x7fb208152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 0x7fb208152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 -- 172.21.15.16:0/1843595649 >> v1:172.21.15.16:6789/0 conn(0x7fb2080a0bb0 legacy=0x7fb2080708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb207e00640 1 -- 172.21.15.16:0/1843595649 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769089629 0 0) 0x7fb2080700f0 con 0x7fb2080a0bb0 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20d600640 1 -- 172.21.15.16:0/1843595649 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb208071140 con 0x7fb2080a07d0 2024-04-26T22:21:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.035+0000 7fb20e000640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 0x7fb208152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:46.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20d600640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2080a07d0 0x7fb208073640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009870 tx=0x7fb1fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712d93de89d95627 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb207e00640 1 -- 172.21.15.16:0/1843595649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0b1070 con 0x7fb2080a07d0 2024-04-26T22:21:46.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb207e00640 1 -- 172.21.15.16:0/1843595649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0a8050 con 0x7fb2080a07d0 2024-04-26T22:21:46.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb207e00640 1 -- 172.21.15.16:0/1843595649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0ac860 con 0x7fb2080a07d0 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- 172.21.15.16:0/1843595649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2080a07d0 msgr2=0x7fb208073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2080a07d0 0x7fb208073640 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009870 tx=0x7fb1fc01c4d0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- 172.21.15.16:0/1843595649 shutdown_connections 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2081489c0 0x7fb208152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- 172.21.15.16:0/1843595649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2080a07d0 0x7fb208073640 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- 172.21.15.16:0/1843595649 >> 172.21.15.16:0/1843595649 conn(0x7fb2080b87c0 msgr2=0x7fb2080b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- 172.21.15.16:0/1843595649 shutdown_connections 2024-04-26T22:21:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- 172.21.15.16:0/1843595649 wait complete. 2024-04-26T22:21:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 Processor -- start 2024-04-26T22:21:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- start start 2024-04-26T22:21:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 0x7fb208144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080a0bb0 0x7fb2081408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb208155f10 con 0x7fb2081489c0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb208155d90 con 0x7fb2080a07d0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb210000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb208156090 con 0x7fb2080a0bb0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56490/0 (socket says 172.21.15.16:56490) 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20e000640 1 -- 172.21.15.16:0/3970258638 learned_addr learned my addr 172.21.15.16:0/3970258638 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20cc00640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080a0bb0 0x7fb2081408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.039+0000 7fb20d600640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 0x7fb208144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 -- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080a0bb0 msgr2=0x7fb2081408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080a0bb0 0x7fb2081408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 -- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 msgr2=0x7fb208144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 0x7fb208144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 -- 172.21.15.16:0/3970258638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080b0fc0 con 0x7fb2081489c0 2024-04-26T22:21:46.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20d600640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 0x7fb208144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb20e000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb20000cef0 tx=0x7fb20000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20001a070 con 0x7fb2081489c0 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20000d860 con 0x7fb2081489c0 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2081439d0 con 0x7fb2081489c0 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20000dc50 con 0x7fb2081489c0 2024-04-26T22:21:46.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb208143f90 con 0x7fb2081489c0 2024-04-26T22:21:46.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb208069530 con 0x7fb2081489c0 2024-04-26T22:21:46.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb20001d070 con 0x7fb2081489c0 2024-04-26T22:21:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.043+0000 7fb205600640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 0x7fb1e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.047+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb2000872b0 con 0x7fb2081489c0 2024-04-26T22:21:46.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.047+0000 7fb20d600640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 0x7fb1e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.047+0000 7fb20d600640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 0x7fb1e806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ae000 tx=0x7fb1fc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.051+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb200057860 con 0x7fb2081489c0 2024-04-26T22:21:46.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.215+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb20806c9f0 con 0x7fb2081489c0 2024-04-26T22:21:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb205600640 1 -- 172.21.15.16:0/3970258638 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fb200057160 con 0x7fb2081489c0 2024-04-26T22:21:46.220 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:46.220 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 msgr2=0x7fb1e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 0x7fb1e806a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0ae000 tx=0x7fb1fc0a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 msgr2=0x7fb208140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb20000cef0 tx=0x7fb20000a710 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 shutdown_connections 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb1e8068380 0x7fb1e806a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2081489c0 0x7fb208140df0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb2080a0bb0 0x7fb2081408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 --2- 172.21.15.16:0/3970258638 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2080a07d0 0x7fb208144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 >> 172.21.15.16:0/3970258638 conn(0x7fb2080b87c0 msgr2=0x7fb2080b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 shutdown_connections 2024-04-26T22:21:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.219+0000 7fb210000640 1 -- 172.21.15.16:0/3970258638 wait complete. 2024-04-26T22:21:46.243 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:46.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:46.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 Processor -- start 2024-04-26T22:21:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 -- start start 2024-04-26T22:21:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 0x7f8d6c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d6c1465c0 0x7f8d6c149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6c06e7f0 con 0x7f8d6c13eec0 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c070a40 con 0x7f8d6c1465c0 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.383+0000 7f8d73a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c070760 con 0x7f8d6c06e410 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d6c1465c0 0x7f8d6c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d6c1465c0 0x7f8d6c149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56500/0 (socket says 172.21.15.16:56500) 2024-04-26T22:21:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 -- 172.21.15.16:0/865987713 learned_addr learned my addr 172.21.15.16:0/865987713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 -- 172.21.15.16:0/865987713 >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 msgr2=0x7f8d6c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d71000640 1 --2- 172.21.15.16:0/865987713 >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 0x7f8d6c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 --2- 172.21.15.16:0/865987713 >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 0x7f8d6c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 -- 172.21.15.16:0/865987713 >> v1:172.21.15.195:6789/0 conn(0x7f8d6c13eec0 legacy=0x7f8d6c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 -- 172.21.15.16:0/865987713 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c148860 con 0x7f8d6c1465c0 2024-04-26T22:21:46.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d71000640 1 --2- 172.21.15.16:0/865987713 >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 0x7f8d6c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:46.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6be00640 1 --2- 172.21.15.16:0/865987713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c149060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c06ea30 tx=0x7f8d5801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857a1b4811440f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6b400640 1 -- 172.21.15.16:0/865987713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580b0070 con 0x7f8d6c1465c0 2024-04-26T22:21:46.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6b400640 1 -- 172.21.15.16:0/865987713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d580ab600 con 0x7f8d6c1465c0 2024-04-26T22:21:46.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.387+0000 7f8d6b400640 1 -- 172.21.15.16:0/865987713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580ab9d0 con 0x7f8d6c1465c0 2024-04-26T22:21:46.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- 172.21.15.16:0/865987713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c1465c0 msgr2=0x7f8d6c149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- 172.21.15.16:0/865987713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c149060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c06ea30 tx=0x7f8d5801c450 comp rx=0 tx=0).stop 2024-04-26T22:21:46.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- 172.21.15.16:0/865987713 shutdown_connections 2024-04-26T22:21:46.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- 172.21.15.16:0/865987713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c149060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- 172.21.15.16:0/865987713 >> v2:172.21.15.195:3300/0 conn(0x7f8d6c06e410 0x7f8d6c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- 172.21.15.16:0/865987713 >> 172.21.15.16:0/865987713 conn(0x7f8d6c0b6590 msgr2=0x7f8d6c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- 172.21.15.16:0/865987713 shutdown_connections 2024-04-26T22:21:46.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- 172.21.15.16:0/865987713 wait complete. 2024-04-26T22:21:46.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 Processor -- start 2024-04-26T22:21:46.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- start start 2024-04-26T22:21:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d6c06e410 0x7f8d6c1e1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c152600 con 0x7f8d6c13eec0 2024-04-26T22:21:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c152480 con 0x7f8d6c1465c0 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d73a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c152780 con 0x7f8d6c06e410 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56512/0 (socket says 172.21.15.16:56512) 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 -- 172.21.15.16:0/686830679 learned_addr learned my addr 172.21.15.16:0/686830679 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d71a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d71000640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d6c06e410 0x7f8d6c1e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 -- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d6c06e410 msgr2=0x7f8d6c1e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d6c06e410 0x7f8d6c1e1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 -- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d6c1465c0 msgr2=0x7f8d6c1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c1449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 -- 172.21.15.16:0/686830679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c13e200 con 0x7f8d6c13eec0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.391+0000 7f8d6be00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d580ae040 tx=0x7f8d580191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580bb070 con 0x7f8d6c13eec0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d580b6650 con 0x7f8d6c13eec0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580b0040 con 0x7f8d6c13eec0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c1e0d80 con 0x7f8d6c13eec0 2024-04-26T22:21:46.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1e1340 con 0x7f8d6c13eec0 2024-04-26T22:21:46.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c069530 con 0x7f8d6c13eec0 2024-04-26T22:21:46.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d580be070 con 0x7f8d6c13eec0 2024-04-26T22:21:46.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 0x7f8d4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8d58120200 con 0x7f8d6c13eec0 2024-04-26T22:21:46.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.395+0000 7f8d71000640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 0x7f8d4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.399+0000 7f8d71000640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 0x7f8d4c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0b5940 tx=0x7f8d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.399+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8d580160d0 con 0x7f8d6c13eec0 2024-04-26T22:21:46.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d6c069f20 con 0x7f8d6c13eec0 2024-04-26T22:21:46.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d68c00640 1 -- 172.21.15.16:0/686830679 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8d580f07b0 con 0x7f8d6c13eec0 2024-04-26T22:21:46.573 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 msgr2=0x7f8d4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 0x7f8d4c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0b5940 tx=0x7f8d60008040 comp rx=0 tx=0).stop 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 msgr2=0x7f8d6c144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d580ae040 tx=0x7f8d580191f0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 shutdown_connections 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8d4c068380 0x7f8d4c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d6c1465c0 0x7f8d6c1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d6c13eec0 0x7f8d6c144010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 --2- 172.21.15.16:0/686830679 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8d6c06e410 0x7f8d6c1e1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 >> 172.21.15.16:0/686830679 conn(0x7f8d6c0b6590 msgr2=0x7f8d6c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 shutdown_connections 2024-04-26T22:21:46.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.571+0000 7f8d73a00640 1 -- 172.21.15.16:0/686830679 wait complete. 2024-04-26T22:21:46.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 Processor -- start 2024-04-26T22:21:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 -- start start 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 0x7f499c142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 0x7f499c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f499c142980 0x7f499c09fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f499c0b7210 con 0x7f499c142980 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f499c0b76a0 con 0x7f499c073860 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f49a1c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f499c0a12d0 con 0x7f499c0b7880 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f499c142980 0x7f499c09fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f499c142980 0x7f499c09fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56522/0 (socket says 172.21.15.16:56522) 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 -- 172.21.15.16:0/2741776940 learned_addr learned my addr 172.21.15.16:0/2741776940 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499aa00640 1 --2- 172.21.15.16:0/2741776940 >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 0x7f499c142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f4992000640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 0x7f499c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 -- 172.21.15.16:0/2741776940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 msgr2=0x7f499c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 0x7f499c070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 -- 172.21.15.16:0/2741776940 >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 msgr2=0x7f499c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 --2- 172.21.15.16:0/2741776940 >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 0x7f499c142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499b400640 1 -- 172.21.15.16:0/2741776940 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c0b6ed0 con 0x7f499c142980 2024-04-26T22:21:46.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f4992000640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 0x7f499c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:46.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.735+0000 7f499aa00640 1 --2- 172.21.15.16:0/2741776940 >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 0x7f499c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:46.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f499b400640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c142980 0x7f499c09fe20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f499c0a1020 tx=0x7f499401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e27c9c513c0c42d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f499a000640 1 -- 172.21.15.16:0/2741776940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940a5800 con 0x7f499c142980 2024-04-26T22:21:46.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f499a000640 1 -- 172.21.15.16:0/2741776940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940a59a0 con 0x7f499c142980 2024-04-26T22:21:46.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f499a000640 1 -- 172.21.15.16:0/2741776940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940a5d70 con 0x7f499c142980 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 -- 172.21.15.16:0/2741776940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c142980 msgr2=0x7f499c09fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c142980 0x7f499c09fe20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f499c0a1020 tx=0x7f499401c960 comp rx=0 tx=0).stop 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 -- 172.21.15.16:0/2741776940 shutdown_connections 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c142980 0x7f499c09fe20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 --2- 172.21.15.16:0/2741776940 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c0b7880 0x7f499c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 --2- 172.21.15.16:0/2741776940 >> v2:172.21.15.195:3300/0 conn(0x7f499c073860 0x7f499c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 -- 172.21.15.16:0/2741776940 >> 172.21.15.16:0/2741776940 conn(0x7f499c0b8850 msgr2=0x7f499c0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 -- 172.21.15.16:0/2741776940 shutdown_connections 2024-04-26T22:21:46.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 -- 172.21.15.16:0/2741776940 wait complete. 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.739+0000 7f49a1c00640 1 Processor -- start 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- start start 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 0x7f499c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f499c142980 0x7f499c1e1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f499c071280 con 0x7f499c1e1ba0 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f499c071100 con 0x7f499c142980 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f499c154e00 con 0x7f499c073860 2024-04-26T22:21:46.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56532/0 (socket says 172.21.15.16:56532) 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 -- 172.21.15.16:0/1721277843 learned_addr learned my addr 172.21.15.16:0/1721277843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f4992000640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f499c142980 0x7f499c1e1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499aa00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 0x7f499c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 -- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 msgr2=0x7f499c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 0x7f499c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 -- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f499c142980 msgr2=0x7f499c1e1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f499c142980 0x7f499c1e1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 -- 172.21.15.16:0/1721277843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c0b4470 con 0x7f499c1e1ba0 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499aa00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 0x7f499c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f499b400640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f499401d200 tx=0x7f4994019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940bc020 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940b88a0 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c145e20 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940b8c90 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c0b4190 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.743+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c069530 con 0x7f499c1e1ba0 2024-04-26T22:21:46.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.747+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49940bf020 con 0x7f499c1e1ba0 2024-04-26T22:21:46.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.747+0000 7f4993400640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 0x7f497806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:46.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.747+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4994121ba0 con 0x7f499c1e1ba0 2024-04-26T22:21:46.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.747+0000 7f499aa00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 0x7f497806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:46.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.747+0000 7f499aa00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 0x7f497806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f499c13fb00 tx=0x7f498c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:46.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.751+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49940c6030 con 0x7f499c1e1ba0 2024-04-26T22:21:46.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.915+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f499c140070 con 0x7f499c1e1ba0 2024-04-26T22:21:46.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.915+0000 7f4993400640 1 -- 172.21.15.16:0/1721277843 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f49940165e0 con 0x7f499c1e1ba0 2024-04-26T22:21:46.918 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:46.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 msgr2=0x7f497806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 0x7f497806a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f499c13fb00 tx=0x7f498c008040 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 msgr2=0x7f499c1e45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f499401d200 tx=0x7f4994019700 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 shutdown_connections 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4978068380 0x7f497806a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f499c1e1ba0 0x7f499c1e45a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f499c142980 0x7f499c1e1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 --2- 172.21.15.16:0/1721277843 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f499c073860 0x7f499c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 >> 172.21.15.16:0/1721277843 conn(0x7f499c0b8850 msgr2=0x7f499c140c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 shutdown_connections 2024-04-26T22:21:46.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:46.919+0000 7f49a1c00640 1 -- 172.21.15.16:0/1721277843 wait complete. 2024-04-26T22:21:46.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:47.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 Processor -- start 2024-04-26T22:21:47.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 -- start start 2024-04-26T22:21:47.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f589c06e410 0x7f589c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f589c1465c0 0x7f589c149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c13eec0 0x7f589c13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f589c070a40 con 0x7f589c1465c0 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f589c06e7f0 con 0x7f589c06e410 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.079+0000 7f58a2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f589c070760 con 0x7f589c13eec0 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f589c1465c0 0x7f589c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f589c1465c0 0x7f589c149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56540/0 (socket says 172.21.15.16:56540) 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 -- 172.21.15.16:0/3840187417 learned_addr learned my addr 172.21.15.16:0/3840187417 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f589be00640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c13eec0 0x7f589c13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f589b400640 1 --2- 172.21.15.16:0/3840187417 >> v2:172.21.15.195:3300/0 conn(0x7f589c06e410 0x7f589c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 -- 172.21.15.16:0/3840187417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c13eec0 msgr2=0x7f589c13f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c13eec0 0x7f589c13f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 -- 172.21.15.16:0/3840187417 >> v2:172.21.15.195:3300/0 conn(0x7f589c06e410 msgr2=0x7f589c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 --2- 172.21.15.16:0/3840187417 >> v2:172.21.15.195:3300/0 conn(0x7f589c06e410 0x7f589c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 -- 172.21.15.16:0/3840187417 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c148860 con 0x7f589c1465c0 2024-04-26T22:21:47.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f5893e00640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c149060 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f589c06ea30 tx=0x7f588401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f7cc6b057041e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f589aa00640 1 -- 172.21.15.16:0/3840187417 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58840b4070 con 0x7f589c1465c0 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f589aa00640 1 -- 172.21.15.16:0/3840187417 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58840a7ae0 con 0x7f589c1465c0 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.083+0000 7f589aa00640 1 -- 172.21.15.16:0/3840187417 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58840af440 con 0x7f589c1465c0 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/3840187417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 msgr2=0x7f589c149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c149060 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f589c06ea30 tx=0x7f588401eb60 comp rx=0 tx=0).stop 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/3840187417 shutdown_connections 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c13eec0 0x7f589c13f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- 172.21.15.16:0/3840187417 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c149060 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- 172.21.15.16:0/3840187417 >> v2:172.21.15.195:3300/0 conn(0x7f589c06e410 0x7f589c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/3840187417 >> 172.21.15.16:0/3840187417 conn(0x7f589c0b6590 msgr2=0x7f589c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:47.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/3840187417 shutdown_connections 2024-04-26T22:21:47.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/3840187417 wait complete. 2024-04-26T22:21:47.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 Processor -- start 2024-04-26T22:21:47.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- start start 2024-04-26T22:21:47.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 0x7f589c0b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 0x7f589c144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f589c145a80 con 0x7f589c1465c0 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f589c145900 con 0x7f589c13eec0 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f589c145c00 con 0x7f589c06e410 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56546/0 (socket says 172.21.15.16:56546) 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 -- 172.21.15.16:0/381216114 learned_addr learned my addr 172.21.15.16:0/381216114 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589b400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 0x7f589c0b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 -- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 msgr2=0x7f589c0b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f5893e00640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 0x7f589c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 0x7f589c0b9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 -- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 msgr2=0x7f589c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 0x7f589c144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 -- 172.21.15.16:0/381216114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c0b0710 con 0x7f589c1465c0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589b400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 0x7f589c0b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f5893e00640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 0x7f589c144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f589be00640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5894007e40 tx=0x7f589400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894014620 con 0x7f589c1465c0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894019070 con 0x7f589c1465c0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589c1339c0 con 0x7f589c1465c0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894014a20 con 0x7f589c1465c0 2024-04-26T22:21:47.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.087+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589c13a100 con 0x7f589c1465c0 2024-04-26T22:21:47.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c1337e0 con 0x7f589c1465c0 2024-04-26T22:21:47.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5894014bc0 con 0x7f589c1465c0 2024-04-26T22:21:47.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f5893400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 0x7f587806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5894087150 con 0x7f589c1465c0 2024-04-26T22:21:47.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f589b400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 0x7f587806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.091+0000 7f589b400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 0x7f587806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f589c14e3c0 tx=0x7f588c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.095+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f589c1337e0 con 0x7f589c1465c0 2024-04-26T22:21:47.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.263+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f589c069530 con 0x7f589c1465c0 2024-04-26T22:21:47.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.263+0000 7f5893400640 1 -- 172.21.15.16:0/381216114 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f58940577a0 con 0x7f589c1465c0 2024-04-26T22:21:47.266 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 msgr2=0x7f587806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 0x7f587806a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f589c14e3c0 tx=0x7f588c008040 comp rx=0 tx=0).stop 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 msgr2=0x7f589c1e3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5894007e40 tx=0x7f589400e4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 shutdown_connections 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5878068380 0x7f587806a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f589c1465c0 0x7f589c1e3cd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f589c13eec0 0x7f589c144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 --2- 172.21.15.16:0/381216114 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f589c06e410 0x7f589c0b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 >> 172.21.15.16:0/381216114 conn(0x7f589c0b6590 msgr2=0x7f589c14ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 shutdown_connections 2024-04-26T22:21:47.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.267+0000 7f58a2400640 1 -- 172.21.15.16:0/381216114 wait complete. 2024-04-26T22:21:47.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-04-26T22:21:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 Processor -- start 2024-04-26T22:21:47.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 -- start start 2024-04-26T22:21:47.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f114006e450 0x7f11400b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 0x7f114013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114006e830 con 0x7f11401451f0 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f11400b0d10 con 0x7f114006e450 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1146200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11400b0a30 con 0x7f114013ef30 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f114006e450 0x7f11400b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f11401451f0 0x7f1140145680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36308/0 (socket says 172.21.15.16:36308) 2024-04-26T22:21:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113fe00640 1 -- 172.21.15.16:0/2312267466 learned_addr learned my addr 172.21.15.16:0/2312267466 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1137e00640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 0x7f114013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113f400640 1 -- 172.21.15.16:0/2312267466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 msgr2=0x7f114013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113f400640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 0x7f114013f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113f400640 1 -- 172.21.15.16:0/2312267466 >> v1:172.21.15.16:6789/0 conn(0x7f11401451f0 legacy=0x7f1140145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113f400640 1 -- 172.21.15.16:0/2312267466 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11400b2cf0 con 0x7f114006e450 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f113ea00640 1 -- 172.21.15.16:0/2312267466 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543811893 0 0) 0x7f114006e830 con 0x7f11401451f0 2024-04-26T22:21:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.427+0000 7f1137e00640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 0x7f114013f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:47.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f113f400640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114006e450 0x7f11400b1020 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11400b0e90 tx=0x7f113001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95daaee4b8b82274 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f113ea00640 1 -- 172.21.15.16:0/2312267466 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11300b0070 con 0x7f114006e450 2024-04-26T22:21:47.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f113ea00640 1 -- 172.21.15.16:0/2312267466 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11300ab600 con 0x7f114006e450 2024-04-26T22:21:47.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f113ea00640 1 -- 172.21.15.16:0/2312267466 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11300ab9d0 con 0x7f114006e450 2024-04-26T22:21:47.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- 172.21.15.16:0/2312267466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114006e450 msgr2=0x7f11400b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114006e450 0x7f11400b1020 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11400b0e90 tx=0x7f113001c380 comp rx=0 tx=0).stop 2024-04-26T22:21:47.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- 172.21.15.16:0/2312267466 shutdown_connections 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f114013ef30 0x7f114013f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 --2- 172.21.15.16:0/2312267466 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114006e450 0x7f11400b1020 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- 172.21.15.16:0/2312267466 >> 172.21.15.16:0/2312267466 conn(0x7f11400b6620 msgr2=0x7f11400b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- 172.21.15.16:0/2312267466 shutdown_connections 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- 172.21.15.16:0/2312267466 wait complete. 2024-04-26T22:21:47.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 Processor -- start 2024-04-26T22:21:47.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.431+0000 7f1146200640 1 -- start start 2024-04-26T22:21:47.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 0x7f1140140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11401451f0 0x7f11401e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11400b6260 con 0x7f114013ef30 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f114013f8d0 con 0x7f114006e450 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11400b63e0 con 0x7f11401451f0 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56568/0 (socket says 172.21.15.16:56568) 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 -- 172.21.15.16:0/2869820903 learned_addr learned my addr 172.21.15.16:0/2869820903 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f113fe00640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11401451f0 0x7f11401e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f113f400640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 0x7f1140140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 -- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11401451f0 msgr2=0x7f11401e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11401451f0 0x7f11401e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 -- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 msgr2=0x7f1140140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 0x7f1140140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 -- 172.21.15.16:0/2869820903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1140140860 con 0x7f114013ef30 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f113f400640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 0x7f1140140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137e00640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f112800c7f0 tx=0x7f112800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128007a30 con 0x7f114013ef30 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1128007bd0 con 0x7f114013ef30 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11280113f0 con 0x7f114013ef30 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1140141330 con 0x7f114013ef30 2024-04-26T22:21:47.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1140140580 con 0x7f114013ef30 2024-04-26T22:21:47.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1140069530 con 0x7f114013ef30 2024-04-26T22:21:47.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.435+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1128011590 con 0x7f114013ef30 2024-04-26T22:21:47.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.439+0000 7f1137400640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 0x7f111c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:47.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.439+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1128086be0 con 0x7f114013ef30 2024-04-26T22:21:47.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.439+0000 7f113f400640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 0x7f111c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:47.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.439+0000 7f113f400640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 0x7f111c06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11300ad000 tx=0x7f11300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:47.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.443+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1128015020 con 0x7f114013ef30 2024-04-26T22:21:47.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:47.663+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7f1140069f00 con 0x7f114013ef30 2024-04-26T22:21:48.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1137400640 1 -- 172.21.15.16:0/2869820903 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v52) ==== 137+0+0 (secure 0 0 0) 0x7f1128056ab0 con 0x7f114013ef30 2024-04-26T22:21:48.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 msgr2=0x7f111c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 0x7f111c06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11300ad000 tx=0x7f11300a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 msgr2=0x7f11400732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f112800c7f0 tx=0x7f112800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 shutdown_connections 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f111c068380 0x7f111c06a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11401451f0 0x7f11401e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f114013ef30 0x7f11400732a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 --2- 172.21.15.16:0/2869820903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f114006e450 0x7f1140140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 >> 172.21.15.16:0/2869820903 conn(0x7f11400b6620 msgr2=0x7f114006d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 shutdown_connections 2024-04-26T22:21:48.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.199+0000 7f1146200640 1 -- 172.21.15.16:0/2869820903 wait complete. 2024-04-26T22:21:48.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:21:48.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 Processor -- start 2024-04-26T22:21:48.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 -- start start 2024-04-26T22:21:48.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fea440b0a30 0x7fea441464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea44070480 con 0x7fea441406e0 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4406e7f0 con 0x7fea4406e410 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4c800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fea44070a60 con 0x7fea440b0a30 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea441406e0 0x7fea44150b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36322/0 (socket says 172.21.15.16:36322) 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.367+0000 7fea4a800640 1 -- 172.21.15.16:0/3842490567 learned_addr learned my addr 172.21.15.16:0/3842490567 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea49400640 1 --2- 172.21.15.16:0/3842490567 >> v2:172.21.15.195:3300/0 conn(0x7fea440b0a30 0x7fea441464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603678827 0 0) 0x7fea44070480 con 0x7fea441406e0 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea2c003530 con 0x7fea441406e0 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea49400640 1 -- 172.21.15.16:0/3842490567 >> v1:172.21.15.195:6789/0 conn(0x7fea4406e410 legacy=0x7fea4413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea49400640 1 -- 172.21.15.16:0/3842490567 >> v1:172.21.15.16:6789/0 conn(0x7fea441406e0 legacy=0x7fea44150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2283191556 0 0) 0x7fea2c003530 con 0x7fea441406e0 2024-04-26T22:21:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea49400640 1 -- 172.21.15.16:0/3842490567 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440706f0 con 0x7fea440b0a30 2024-04-26T22:21:48.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea49400640 1 --2- 172.21.15.16:0/3842490567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea440b0a30 0x7fea441464e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea340097c0 tx=0x7fea3401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a52876ed75008b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340b0070 con 0x7fea440b0a30 2024-04-26T22:21:48.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340ab400 con 0x7fea440b0a30 2024-04-26T22:21:48.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.371+0000 7fea48a00640 1 -- 172.21.15.16:0/3842490567 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40001a00 con 0x7fea440b0a30 2024-04-26T22:21:48.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- 172.21.15.16:0/3842490567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea440b0a30 msgr2=0x7fea441464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 --2- 172.21.15.16:0/3842490567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea440b0a30 0x7fea441464e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea340097c0 tx=0x7fea3401c330 comp rx=0 tx=0).stop 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- 172.21.15.16:0/3842490567 shutdown_connections 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 --2- 172.21.15.16:0/3842490567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea440b0a30 0x7fea441464e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- 172.21.15.16:0/3842490567 >> 172.21.15.16:0/3842490567 conn(0x7fea440b6590 msgr2=0x7fea440b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- 172.21.15.16:0/3842490567 shutdown_connections 2024-04-26T22:21:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- 172.21.15.16:0/3842490567 wait complete. 2024-04-26T22:21:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 Processor -- start 2024-04-26T22:21:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- start start 2024-04-26T22:21:48.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4406e410 0x7fea44072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea441406e0 0x7fea441e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea44154c40 con 0x7fea440b0a30 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fea44154ac0 con 0x7fea4406e410 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4c800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fea44154dc0 con 0x7fea441406e0 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56578/0 (socket says 172.21.15.16:56578) 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 -- 172.21.15.16:0/1235514081 learned_addr learned my addr 172.21.15.16:0/1235514081 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49e00640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4406e410 0x7fea44072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea4a800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea441406e0 0x7fea441e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 -- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea441406e0 msgr2=0x7fea441e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea441406e0 0x7fea441e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 -- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4406e410 msgr2=0x7fea44072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4406e410 0x7fea44072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.375+0000 7fea49400640 1 -- 172.21.15.16:0/1235514081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea44141220 con 0x7fea440b0a30 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea49400640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea340ae040 tx=0x7fea3401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340bb020 con 0x7fea440b0a30 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea340b1040 con 0x7fea440b0a30 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea340b0050 con 0x7fea440b0a30 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea440af9b0 con 0x7fea440b0a30 2024-04-26T22:21:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea44073540 con 0x7fea440b0a30 2024-04-26T22:21:48.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea44073090 con 0x7fea440b0a30 2024-04-26T22:21:48.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea340be070 con 0x7fea440b0a30 2024-04-26T22:21:48.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 0x7fea2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fea3411ff10 con 0x7fea440b0a30 2024-04-26T22:21:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.379+0000 7fea49e00640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 0x7fea2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.383+0000 7fea49e00640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 0x7fea2806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea38007fd0 tx=0x7fea38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.383+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea34015fb0 con 0x7fea440b0a30 2024-04-26T22:21:48.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.547+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fea44069530 con 0x7fea440b0a30 2024-04-26T22:21:48.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.551+0000 7fea3e000640 1 -- 172.21.15.16:0/1235514081 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fea340eff10 con 0x7fea440b0a30 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 msgr2=0x7fea2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 0x7fea2806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea38007fd0 tx=0x7fea38009040 comp rx=0 tx=0).stop 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 msgr2=0x7fea440b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea340ae040 tx=0x7fea3401ab70 comp rx=0 tx=0).stop 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 shutdown_connections 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fea28068380 0x7fea2806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fea441406e0 0x7fea441e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea440b0a30 0x7fea440b0f90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 --2- 172.21.15.16:0/1235514081 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea4406e410 0x7fea44072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 >> 172.21.15.16:0/1235514081 conn(0x7fea440b6590 msgr2=0x7fea44144200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 shutdown_connections 2024-04-26T22:21:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.555+0000 7fea4c800640 1 -- 172.21.15.16:0/1235514081 wait complete. 2024-04-26T22:21:48.577 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:21:48.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:21:48.623 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:21:48.717 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:21:48.717 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:21:48.717 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:21:48.726 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:21:48.726 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:21:48.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 Processor -- start 2024-04-26T22:21:48.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 -- start start 2024-04-26T22:21:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17900b28e0 0x7f1790144e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 0x7f17901453c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17900b3cd0 con 0x7f17900b3780 2024-04-26T22:21:48.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1790142780 con 0x7f17900b28e0 2024-04-26T22:21:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f1794c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f17900b1ef0 con 0x7f1790142360 2024-04-26T22:21:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17900b28e0 0x7f1790144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178d400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f17900b3780 0x7f1790141c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36332/0 (socket says 172.21.15.16:36332) 2024-04-26T22:21:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178d400640 1 -- 172.21.15.16:0/2711125264 learned_addr learned my addr 172.21.15.16:0/2711125264 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:48.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17900b28e0 0x7f1790144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56582/0 (socket says 172.21.15.16:56582) 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 -- 172.21.15.16:0/2711125264 >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 msgr2=0x7f17901453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178e800640 1 --2- 172.21.15.16:0/2711125264 >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 0x7f17901453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178ca00640 1 -- 172.21.15.16:0/2711125264 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619468146 0 0) 0x7f17900b3cd0 con 0x7f17900b3780 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 --2- 172.21.15.16:0/2711125264 >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 0x7f17901453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 -- 172.21.15.16:0/2711125264 >> v1:172.21.15.16:6789/0 conn(0x7f17900b3780 legacy=0x7f1790141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178de00640 1 -- 172.21.15.16:0/2711125264 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17900b21d0 con 0x7f17900b28e0 2024-04-26T22:21:48.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.963+0000 7f178e800640 1 --2- 172.21.15.16:0/2711125264 >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 0x7f17901453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f178de00640 1 --2- 172.21.15.16:0/2711125264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17900b28e0 0x7f1790144e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17900b5fd0 tx=0x7f178001d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5a06c2977d8738 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f178ca00640 1 -- 172.21.15.16:0/2711125264 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17800b3070 con 0x7f17900b28e0 2024-04-26T22:21:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f178ca00640 1 -- 172.21.15.16:0/2711125264 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800a6720 con 0x7f17900b28e0 2024-04-26T22:21:48.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f178ca00640 1 -- 172.21.15.16:0/2711125264 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178000b040 con 0x7f17900b28e0 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- 172.21.15.16:0/2711125264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17900b28e0 msgr2=0x7f1790144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 --2- 172.21.15.16:0/2711125264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17900b28e0 0x7f1790144e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17900b5fd0 tx=0x7f178001d7c0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- 172.21.15.16:0/2711125264 shutdown_connections 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 --2- 172.21.15.16:0/2711125264 >> v2:172.21.15.195:3300/0 conn(0x7f1790142360 0x7f17901453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 --2- 172.21.15.16:0/2711125264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17900b28e0 0x7f1790144e80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- 172.21.15.16:0/2711125264 >> 172.21.15.16:0/2711125264 conn(0x7f17900b6620 msgr2=0x7f17900b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- 172.21.15.16:0/2711125264 shutdown_connections 2024-04-26T22:21:48.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- 172.21.15.16:0/2711125264 wait complete. 2024-04-26T22:21:48.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 Processor -- start 2024-04-26T22:21:48.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.967+0000 7f1794c00640 1 -- start start 2024-04-26T22:21:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17900b28e0 0x7f179013bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17900b3780 0x7f17901e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f17901512e0 con 0x7f1790142360 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b0ce0 con 0x7f17900b28e0 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1790151460 con 0x7f17900b3780 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56596/0 (socket says 172.21.15.16:56596) 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 -- 172.21.15.16:0/3373636557 learned_addr learned my addr 172.21.15.16:0/3373636557 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178d400640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17900b3780 0x7f17901e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178de00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17900b28e0 0x7f179013bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 -- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17900b3780 msgr2=0x7f17901e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17900b3780 0x7f17901e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 -- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17900b28e0 msgr2=0x7f179013bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17900b28e0 0x7f179013bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 -- 172.21.15.16:0/3373636557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17900713e0 con 0x7f1790142360 2024-04-26T22:21:48.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f178e800640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f178800cd50 tx=0x7f178800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178800f680 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178800f840 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178800fc30 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901e3b50 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179013d5a0 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790069530 con 0x7f1790142360 2024-04-26T22:21:48.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.971+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f178800e3e0 con 0x7f1790142360 2024-04-26T22:21:48.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.975+0000 7f1786000640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 0x7f177006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:48.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.975+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f17880875f0 con 0x7f1790142360 2024-04-26T22:21:48.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.975+0000 7f178de00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 0x7f177006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:48.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.975+0000 7f178de00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 0x7f177006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17800b0000 tx=0x7f1780008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:48.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:48.979+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1788014030 con 0x7f1790142360 2024-04-26T22:21:49.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.143+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f179006cb10 con 0x7f1790142360 2024-04-26T22:21:49.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1786000640 1 -- 172.21.15.16:0/3373636557 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f1788057550 con 0x7f1790142360 2024-04-26T22:21:49.148 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:49.148 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 msgr2=0x7f177006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 0x7f177006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17800b0000 tx=0x7f1780008040 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 msgr2=0x7f1790140a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f178800cd50 tx=0x7f178800a650 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 shutdown_connections 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1770068380 0x7f177006a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1790142360 0x7f1790140a90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17900b3780 0x7f17901e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 --2- 172.21.15.16:0/3373636557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17900b28e0 0x7f179013bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 >> 172.21.15.16:0/3373636557 conn(0x7f17900b6620 msgr2=0x7f17900af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 shutdown_connections 2024-04-26T22:21:49.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.147+0000 7f1794c00640 1 -- 172.21.15.16:0/3373636557 wait complete. 2024-04-26T22:21:49.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:49.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 Processor -- start 2024-04-26T22:21:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 -- start start 2024-04-26T22:21:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f028c0b7880 0x7f028c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 0x7f028c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f028c0a12d0 con 0x7f028c073860 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f028c0b7210 con 0x7f028c0b7880 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f0291800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f028c0b76a0 con 0x7f028c070550 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f028aa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f028c073860 0x7f028c142440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36348/0 (socket says 172.21.15.16:36348) 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f028aa00640 1 -- 172.21.15.16:0/321644257 learned_addr learned my addr 172.21.15.16:0/321644257 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.311+0000 7f028b400640 1 --2- 172.21.15.16:0/321644257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 0x7f028c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f0283e00640 1 --2- 172.21.15.16:0/321644257 >> v2:172.21.15.195:3300/0 conn(0x7f028c0b7880 0x7f028c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028a000640 1 -- 172.21.15.16:0/321644257 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409365407 0 0) 0x7f028c0a12d0 con 0x7f028c073860 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028a000640 1 -- 172.21.15.16:0/321644257 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0270003530 con 0x7f028c073860 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028b400640 1 -- 172.21.15.16:0/321644257 >> v2:172.21.15.195:3300/0 conn(0x7f028c0b7880 msgr2=0x7f028c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028b400640 1 --2- 172.21.15.16:0/321644257 >> v2:172.21.15.195:3300/0 conn(0x7f028c0b7880 0x7f028c070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028b400640 1 -- 172.21.15.16:0/321644257 >> v1:172.21.15.16:6789/0 conn(0x7f028c073860 legacy=0x7f028c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028b400640 1 -- 172.21.15.16:0/321644257 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c0b6ed0 con 0x7f028c070550 2024-04-26T22:21:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028b400640 1 --2- 172.21.15.16:0/321644257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 0x7f028c152df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f028c0b7390 tx=0x7f028401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e309bebf9d7266d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028a000640 1 -- 172.21.15.16:0/321644257 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02840b2070 con 0x7f028c070550 2024-04-26T22:21:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028a000640 1 -- 172.21.15.16:0/321644257 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02840a5980 con 0x7f028c070550 2024-04-26T22:21:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.315+0000 7f028a000640 1 -- 172.21.15.16:0/321644257 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02840a5d50 con 0x7f028c070550 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- 172.21.15.16:0/321644257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 msgr2=0x7f028c152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- 172.21.15.16:0/321644257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 0x7f028c152df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f028c0b7390 tx=0x7f028401c8c0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- 172.21.15.16:0/321644257 shutdown_connections 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- 172.21.15.16:0/321644257 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c070550 0x7f028c152df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- 172.21.15.16:0/321644257 >> v2:172.21.15.195:3300/0 conn(0x7f028c0b7880 0x7f028c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- 172.21.15.16:0/321644257 >> 172.21.15.16:0/321644257 conn(0x7f028c0b8850 msgr2=0x7f028c0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- 172.21.15.16:0/321644257 shutdown_connections 2024-04-26T22:21:49.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- 172.21.15.16:0/321644257 wait complete. 2024-04-26T22:21:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 Processor -- start 2024-04-26T22:21:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- start start 2024-04-26T22:21:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 0x7f028c0b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 0x7f028c146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f028c071280 con 0x7f028c070550 2024-04-26T22:21:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f028c071100 con 0x7f028c073860 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0291800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f028c142b50 con 0x7f028c0b1590 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56598/0 (socket says 172.21.15.16:56598) 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 -- 172.21.15.16:0/35602136 learned_addr learned my addr 172.21.15.16:0/35602136 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028b400640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 0x7f028c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0283e00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 0x7f028c0b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 -- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 msgr2=0x7f028c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 0x7f028c146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 -- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 msgr2=0x7f028c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 0x7f028c0b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 -- 172.21.15.16:0/35602136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028c0b1a00 con 0x7f028c070550 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028b400640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 0x7f028c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f0283e00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 0x7f028c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.319+0000 7f028aa00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c3c0 tx=0x7f027c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c017070 con 0x7f028c070550 2024-04-26T22:21:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c005cf0 con 0x7f028c070550 2024-04-26T22:21:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c0072f0 con 0x7f028c070550 2024-04-26T22:21:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f028c0b2860 con 0x7f028c070550 2024-04-26T22:21:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f028c148c00 con 0x7f028c070550 2024-04-26T22:21:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f028c069530 con 0x7f028c070550 2024-04-26T22:21:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f027c01a070 con 0x7f028c070550 2024-04-26T22:21:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 0x7f026806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f027c085de0 con 0x7f028c070550 2024-04-26T22:21:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.323+0000 7f0283e00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 0x7f026806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.327+0000 7f0283e00640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 0x7f026806a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f028c13de60 tx=0x7f0274008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.327+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f027c056310 con 0x7f028c070550 2024-04-26T22:21:49.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.491+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f028c0b6190 con 0x7f028c070550 2024-04-26T22:21:49.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.491+0000 7f0282a00640 1 -- 172.21.15.16:0/35602136 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f027c055c10 con 0x7f028c070550 2024-04-26T22:21:49.496 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:49.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 msgr2=0x7f026806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 0x7f026806a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f028c13de60 tx=0x7f0274008040 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 msgr2=0x7f028c145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c3c0 tx=0x7f027c00c880 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 shutdown_connections 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f02680683b0 0x7f026806a870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f028c0b1590 0x7f028c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f028c073860 0x7f028c0b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 --2- 172.21.15.16:0/35602136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f028c070550 0x7f028c145810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 >> 172.21.15.16:0/35602136 conn(0x7f028c0b8850 msgr2=0x7f028c1418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 shutdown_connections 2024-04-26T22:21:49.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.495+0000 7f0291800640 1 -- 172.21.15.16:0/35602136 wait complete. 2024-04-26T22:21:49.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:49.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 Processor -- start 2024-04-26T22:21:49.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 -- start start 2024-04-26T22:21:49.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6fc806e410 0x7f6fc80b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81465c0 0x7f6fc8149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fc806e7f0 con 0x7f6fc813eec0 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc8070a40 con 0x7f6fc806e410 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcf200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc8070760 con 0x7f6fc81465c0 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fc7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6fc806e410 0x7f6fc80b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcd200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6fc813eec0 0x7f6fc813f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36350/0 (socket says 172.21.15.16:36350) 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fc7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6fc806e410 0x7f6fc80b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56608/0 (socket says 172.21.15.16:56608) 2024-04-26T22:21:49.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fcd200640 1 -- 172.21.15.16:0/42342735 learned_addr learned my addr 172.21.15.16:0/42342735 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.663+0000 7f6fbfe00640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81465c0 0x7f6fc8149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7e00640 1 -- 172.21.15.16:0/42342735 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81465c0 msgr2=0x7f6fc8149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7e00640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81465c0 0x7f6fc8149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7e00640 1 -- 172.21.15.16:0/42342735 >> v1:172.21.15.16:6789/0 conn(0x7f6fc813eec0 legacy=0x7f6fc813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7e00640 1 -- 172.21.15.16:0/42342735 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc8148860 con 0x7f6fc806e410 2024-04-26T22:21:49.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7400640 1 -- 172.21.15.16:0/42342735 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513152269 0 0) 0x7f6fc806e7f0 con 0x7f6fc813eec0 2024-04-26T22:21:49.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7e00640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc806e410 0x7f6fc80b30d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097c0 tx=0x7f6fb801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d687d48f050c0ae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7400640 1 -- 172.21.15.16:0/42342735 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80b0070 con 0x7f6fc806e410 2024-04-26T22:21:49.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7400640 1 -- 172.21.15.16:0/42342735 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80ab600 con 0x7f6fc806e410 2024-04-26T22:21:49.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fc7400640 1 -- 172.21.15.16:0/42342735 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80ab9d0 con 0x7f6fc806e410 2024-04-26T22:21:49.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 -- 172.21.15.16:0/42342735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc806e410 msgr2=0x7f6fc80b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc806e410 0x7f6fc80b30d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80097c0 tx=0x7f6fb801c410 comp rx=0 tx=0).stop 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 -- 172.21.15.16:0/42342735 shutdown_connections 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc81465c0 0x7f6fc8149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 --2- 172.21.15.16:0/42342735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc806e410 0x7f6fc80b30d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 -- 172.21.15.16:0/42342735 >> 172.21.15.16:0/42342735 conn(0x7f6fc80b6590 msgr2=0x7f6fc80b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 -- 172.21.15.16:0/42342735 shutdown_connections 2024-04-26T22:21:49.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.667+0000 7f6fcf200640 1 -- 172.21.15.16:0/42342735 wait complete. 2024-04-26T22:21:49.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 Processor -- start 2024-04-26T22:21:49.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- start start 2024-04-26T22:21:49.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806e410 0x7f6fc8136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 0x7f6fc8144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc8152600 con 0x7f6fc81465c0 2024-04-26T22:21:49.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc8152480 con 0x7f6fc806e410 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc8152780 con 0x7f6fc813eec0 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56622/0 (socket says 172.21.15.16:56622) 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 -- 172.21.15.16:0/3044398084 learned_addr learned my addr 172.21.15.16:0/3044398084 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fc7e00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806e410 0x7f6fc8136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fbfe00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 0x7f6fc8144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 -- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 msgr2=0x7f6fc8144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 0x7f6fc8144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 -- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806e410 msgr2=0x7f6fc8136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806e410 0x7f6fc8136f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 -- 172.21.15.16:0/3044398084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc81452d0 con 0x7f6fc81465c0 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fbfe00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 0x7f6fc8144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcd200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c700 tx=0x7f6fc000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0018070 con 0x7f6fc81465c0 2024-04-26T22:21:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc000ce10 con 0x7f6fc81465c0 2024-04-26T22:21:49.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc80b0e90 con 0x7f6fc81465c0 2024-04-26T22:21:49.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000a800 con 0x7f6fc81465c0 2024-04-26T22:21:49.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.671+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc8145ed0 con 0x7f6fc81465c0 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc8069530 con 0x7f6fc81465c0 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6fc001b070 con 0x7f6fc81465c0 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fc4c00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 0x7f6fa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6fc0085e90 con 0x7f6fc81465c0 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fc7e00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 0x7f6fa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:49.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.675+0000 7f6fc7e00640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 0x7f6fa406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80ad000 tx=0x7f6fb80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:49.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.679+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6fc0055d60 con 0x7f6fc81465c0 2024-04-26T22:21:49.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.871+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6fc8141d70 con 0x7f6fc81465c0 2024-04-26T22:21:49.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.871+0000 7f6fc4c00640 1 -- 172.21.15.16:0/3044398084 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f6fc005a060 con 0x7f6fc81465c0 2024-04-26T22:21:49.875 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 msgr2=0x7f6fa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 0x7f6fa406a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80ad000 tx=0x7f6fb80a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 msgr2=0x7f6fc81df0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c700 tx=0x7f6fc000cbc0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 shutdown_connections 2024-04-26T22:21:49.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6fa4068380 0x7f6fa406a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc81465c0 0x7f6fc81df0e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fc813eec0 0x7f6fc8144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 --2- 172.21.15.16:0/3044398084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc806e410 0x7f6fc8136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 >> 172.21.15.16:0/3044398084 conn(0x7f6fc80b6590 msgr2=0x7f6fc80b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 shutdown_connections 2024-04-26T22:21:49.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:49.875+0000 7f6fcf200640 1 -- 172.21.15.16:0/3044398084 wait complete. 2024-04-26T22:21:49.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:50.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.035+0000 7f9019000640 1 Processor -- start 2024-04-26T22:21:50.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 -- start start 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9014073810 0x7f90140b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f90140b8380 0x7f9014149f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901414a490 0x7f90140b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f901406f500 con 0x7f9014073810 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f901414a900 con 0x7f90140b8380 2024-04-26T22:21:50.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9019000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9014073bf0 con 0x7f901414a490 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9014073810 0x7f90140b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9014073810 0x7f90140b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56628/0 (socket says 172.21.15.16:56628) 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 -- 172.21.15.16:0/3272696821 learned_addr learned my addr 172.21.15.16:0/3272696821 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f900be00640 1 --2- 172.21.15.16:0/3272696821 >> v2:172.21.15.195:3300/0 conn(0x7f90140b8380 0x7f9014149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9012800640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901414a490 0x7f90140b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 -- 172.21.15.16:0/3272696821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901414a490 msgr2=0x7f90140b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901414a490 0x7f90140b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 -- 172.21.15.16:0/3272696821 >> v2:172.21.15.195:3300/0 conn(0x7f90140b8380 msgr2=0x7f9014149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:50.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 --2- 172.21.15.16:0/3272696821 >> v2:172.21.15.195:3300/0 conn(0x7f90140b8380 0x7f9014149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.039+0000 7f9011e00640 1 -- 172.21.15.16:0/3272696821 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90140b1030 con 0x7f9014073810 2024-04-26T22:21:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9011e00640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9014073810 0x7f90140b7e40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90140b9880 tx=0x7f900401c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47f8c3371a0ae51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9011400640 1 -- 172.21.15.16:0/3272696821 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90040b0070 con 0x7f9014073810 2024-04-26T22:21:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9011400640 1 -- 172.21.15.16:0/3272696821 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90040ab600 con 0x7f9014073810 2024-04-26T22:21:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9011400640 1 -- 172.21.15.16:0/3272696821 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90040ab9d0 con 0x7f9014073810 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- 172.21.15.16:0/3272696821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9014073810 msgr2=0x7f90140b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9014073810 0x7f90140b7e40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90140b9880 tx=0x7f900401c1a0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- 172.21.15.16:0/3272696821 shutdown_connections 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f901414a490 0x7f90140b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 --2- 172.21.15.16:0/3272696821 >> v2:172.21.15.195:3300/0 conn(0x7f90140b8380 0x7f9014149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 --2- 172.21.15.16:0/3272696821 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9014073810 0x7f90140b7e40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- 172.21.15.16:0/3272696821 >> 172.21.15.16:0/3272696821 conn(0x7f90140bc570 msgr2=0x7f90140b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- 172.21.15.16:0/3272696821 shutdown_connections 2024-04-26T22:21:50.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- 172.21.15.16:0/3272696821 wait complete. 2024-04-26T22:21:50.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 Processor -- start 2024-04-26T22:21:50.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.043+0000 7f9019000640 1 -- start start 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014073810 0x7f9014148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 0x7f90140b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9014071200 con 0x7f901414a490 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9014071080 con 0x7f9014073810 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f901406f730 con 0x7f90140b8380 2024-04-26T22:21:50.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56640/0 (socket says 172.21.15.16:56640) 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 -- 172.21.15.16:0/740310745 learned_addr learned my addr 172.21.15.16:0/740310745 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9011e00640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014073810 0x7f9014148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900be00640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 0x7f90140b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 -- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 msgr2=0x7f90140b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 0x7f90140b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 -- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014073810 msgr2=0x7f9014148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014073810 0x7f9014148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 -- 172.21.15.16:0/740310745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9014147f40 con 0x7f901414a490 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900be00640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 0x7f90140b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:50.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9012800640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d30 tx=0x7f900c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c018020 con 0x7f901414a490 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c014480 con 0x7f901414a490 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90140b5600 con 0x7f901414a490 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c014870 con 0x7f901414a490 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9014147ab0 con 0x7f901414a490 2024-04-26T22:21:50.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9014069530 con 0x7f901414a490 2024-04-26T22:21:50.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.047+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f900c01b020 con 0x7f901414a490 2024-04-26T22:21:50.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.051+0000 7f900a000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 0x7f8ff006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.051+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f900c087620 con 0x7f901414a490 2024-04-26T22:21:50.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.051+0000 7f9011e00640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 0x7f8ff006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.051+0000 7f9011e00640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 0x7f8ff006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90040ad000 tx=0x7f9004008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.055+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f900c022030 con 0x7f901414a490 2024-04-26T22:21:50.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f90140b30b0 con 0x7f901414a490 2024-04-26T22:21:50.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f900a000640 1 -- 172.21.15.16:0/740310745 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f900c010040 con 0x7f901414a490 2024-04-26T22:21:50.221 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 msgr2=0x7f8ff006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 0x7f8ff006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f90040ad000 tx=0x7f9004008040 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 msgr2=0x7f90140a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d30 tx=0x7f900c00c490 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 shutdown_connections 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8ff0068380 0x7f8ff006a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f901414a490 0x7f90140a0080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f90140b8380 0x7f90140b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 --2- 172.21.15.16:0/740310745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9014073810 0x7f9014148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 >> 172.21.15.16:0/740310745 conn(0x7f90140bc570 msgr2=0x7f90140b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 shutdown_connections 2024-04-26T22:21:50.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.219+0000 7f9019000640 1 -- 172.21.15.16:0/740310745 wait complete. 2024-04-26T22:21:50.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:21:50.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 Processor -- start 2024-04-26T22:21:50.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 -- start start 2024-04-26T22:21:50.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c28070620 0x7f0c28146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c2814a0c0 0x7f0c2813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c280718f0 con 0x7f0c280b3710 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0c281467b0 con 0x7f0c28070620 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c2d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c28070a00 con 0x7f0c2814a0c0 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c28070620 0x7f0c28146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c1de00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0c280b3710 0x7f0c281499b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36360/0 (socket says 172.21.15.16:36360) 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c28070620 0x7f0c28146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56652/0 (socket says 172.21.15.16:56652) 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c1de00640 1 -- 172.21.15.16:0/2651420438 learned_addr learned my addr 172.21.15.16:0/2651420438 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:50.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c27200640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c2814a0c0 0x7f0c2813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 -- 172.21.15.16:0/2651420438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c2814a0c0 msgr2=0x7f0c2813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:50.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c2814a0c0 0x7f0c2813fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 -- 172.21.15.16:0/2651420438 >> v1:172.21.15.16:6789/0 conn(0x7f0c280b3710 legacy=0x7f0c281499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c26800640 1 -- 172.21.15.16:0/2651420438 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c28146a40 con 0x7f0c28070620 2024-04-26T22:21:50.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.383+0000 7f0c25e00640 1 -- 172.21.15.16:0/2651420438 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199977265 0 0) 0x7f0c280718f0 con 0x7f0c280b3710 2024-04-26T22:21:50.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c26800640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28146270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097c0 tx=0x7f0c1801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3eb4cc82a51f3ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c25e00640 1 -- 172.21.15.16:0/2651420438 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c180b1070 con 0x7f0c28070620 2024-04-26T22:21:50.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c25e00640 1 -- 172.21.15.16:0/2651420438 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c180a8050 con 0x7f0c28070620 2024-04-26T22:21:50.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c25e00640 1 -- 172.21.15.16:0/2651420438 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c180ac860 con 0x7f0c28070620 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 -- 172.21.15.16:0/2651420438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 msgr2=0x7f0c28146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28146270 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097c0 tx=0x7f0c1801c3e0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 -- 172.21.15.16:0/2651420438 shutdown_connections 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c2814a0c0 0x7f0c2813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 --2- 172.21.15.16:0/2651420438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28146270 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 -- 172.21.15.16:0/2651420438 >> 172.21.15.16:0/2651420438 conn(0x7f0c280b6620 msgr2=0x7f0c280b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 -- 172.21.15.16:0/2651420438 shutdown_connections 2024-04-26T22:21:50.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.387+0000 7f0c2d400640 1 -- 172.21.15.16:0/2651420438 wait complete. 2024-04-26T22:21:50.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 Processor -- start 2024-04-26T22:21:50.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- start start 2024-04-26T22:21:50.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c2814a0c0 0x7f0c2813ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 0x7f0c2813ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28153530 con 0x7f0c28070620 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281533b0 con 0x7f0c2814a0c0 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0c281536b0 con 0x7f0c28139f70 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c26800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c26800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56662/0 (socket says 172.21.15.16:56662) 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c26800640 1 -- 172.21.15.16:0/134583140 learned_addr learned my addr 172.21.15.16:0/134583140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 0x7f0c2813ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c1de00640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c2814a0c0 0x7f0c2813ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 -- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c2814a0c0 msgr2=0x7f0c2813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c2814a0c0 0x7f0c2813ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 -- 172.21.15.16:0/134583140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 msgr2=0x7f0c28139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 -- 172.21.15.16:0/134583140 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2813b9d0 con 0x7f0c28139f70 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c26800640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c27200640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 0x7f0c2813ef70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000d4b0 tx=0x7f0c2000d970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20004020 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c200041e0 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200043d0 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2813a490 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2814e960 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.391+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c28069450 con 0x7f0c28139f70 2024-04-26T22:21:50.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.395+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c2001b020 con 0x7f0c28139f70 2024-04-26T22:21:50.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.395+0000 7f0c1f400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 0x7f0c0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.395+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0c20086580 con 0x7f0c28139f70 2024-04-26T22:21:50.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.395+0000 7f0c26800640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 0x7f0c0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.395+0000 7f0c26800640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 0x7f0c0406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c1801aa90 tx=0x7f0c18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.399+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c20056460 con 0x7f0c28139f70 2024-04-26T22:21:50.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c2806e220 con 0x7f0c28139f70 2024-04-26T22:21:50.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c1f400640 1 -- 172.21.15.16:0/134583140 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f0c2005a760 con 0x7f0c28139f70 2024-04-26T22:21:50.581 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 msgr2=0x7f0c0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 0x7f0c0406a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c1801aa90 tx=0x7f0c18008040 comp rx=0 tx=0).stop 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 msgr2=0x7f0c2813ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 0x7f0c2813ef70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000d4b0 tx=0x7f0c2000d970 comp rx=0 tx=0).stop 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 shutdown_connections 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0c04068380 0x7f0c0406a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0c28139f70 0x7f0c2813ef70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c2814a0c0 0x7f0c2813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 --2- 172.21.15.16:0/134583140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c28070620 0x7f0c28139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 >> 172.21.15.16:0/134583140 conn(0x7f0c280b6620 msgr2=0x7f0c2806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 shutdown_connections 2024-04-26T22:21:50.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.579+0000 7f0c2d400640 1 -- 172.21.15.16:0/134583140 wait complete. 2024-04-26T22:21:50.602 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:21:50.602 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:21:50.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:50.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.787+0000 7fe55d800640 1 Processor -- start 2024-04-26T22:21:50.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.787+0000 7fe55d800640 1 -- start start 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe55d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55806e450 0x7fe5580b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe55d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5580b0ac0 0x7fe558150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe55d800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580b3f50 con 0x7fe5580b58d0 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe55d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe5580b3310 con 0x7fe5580b0ac0 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe55d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe558070790 con 0x7fe55806e450 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5580b0ac0 0x7fe558150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe556a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55806e450 0x7fe5580b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5580b0ac0 0x7fe558150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56666/0 (socket says 172.21.15.16:56666) 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 -- 172.21.15.16:0/2458178230 learned_addr learned my addr 172.21.15.16:0/2458178230 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 -- 172.21.15.16:0/2458178230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55806e450 msgr2=0x7fe5580b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 --2- 172.21.15.16:0/2458178230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55806e450 0x7fe5580b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 -- 172.21.15.16:0/2458178230 >> v1:172.21.15.195:6789/0 conn(0x7fe5580b58d0 legacy=0x7fe558140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 -- 172.21.15.16:0/2458178230 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55806e830 con 0x7fe5580b0ac0 2024-04-26T22:21:50.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.791+0000 7fe557400640 1 --2- 172.21.15.16:0/2458178230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b0ac0 0x7fe558150b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe550009e50 tx=0x7fe55001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c217b5883cc268e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe556000640 1 -- 172.21.15.16:0/2458178230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500a5830 con 0x7fe5580b0ac0 2024-04-26T22:21:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe556000640 1 -- 172.21.15.16:0/2458178230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5500a59d0 con 0x7fe5580b0ac0 2024-04-26T22:21:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe556000640 1 -- 172.21.15.16:0/2458178230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500a5da0 con 0x7fe5580b0ac0 2024-04-26T22:21:50.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- 172.21.15.16:0/2458178230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b0ac0 msgr2=0x7fe558150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- 172.21.15.16:0/2458178230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b0ac0 0x7fe558150b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe550009e50 tx=0x7fe55001c970 comp rx=0 tx=0).stop 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- 172.21.15.16:0/2458178230 shutdown_connections 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- 172.21.15.16:0/2458178230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b0ac0 0x7fe558150b50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- 172.21.15.16:0/2458178230 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe55806e450 0x7fe5580b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- 172.21.15.16:0/2458178230 >> 172.21.15.16:0/2458178230 conn(0x7fe5580b6620 msgr2=0x7fe5580b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- 172.21.15.16:0/2458178230 shutdown_connections 2024-04-26T22:21:50.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- 172.21.15.16:0/2458178230 wait complete. 2024-04-26T22:21:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 Processor -- start 2024-04-26T22:21:50.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- start start 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55806e450 0x7fe558149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5580b0ac0 0x7fe558147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe558153a30 con 0x7fe5580b58d0 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe5581538b0 con 0x7fe55806e450 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe55d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe558153bb0 con 0x7fe5580b0ac0 2024-04-26T22:21:50.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56674/0 (socket says 172.21.15.16:56674) 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 -- 172.21.15.16:0/4154232512 learned_addr learned my addr 172.21.15.16:0/4154232512 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe556a00640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55806e450 0x7fe558149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe54e000640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5580b0ac0 0x7fe558147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 -- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5580b0ac0 msgr2=0x7fe558147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5580b0ac0 0x7fe558147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 -- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55806e450 msgr2=0x7fe558149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55806e450 0x7fe558149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.795+0000 7fe557400640 1 -- 172.21.15.16:0/4154232512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558149510 con 0x7fe5580b58d0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe557400640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe550009e50 tx=0x7fe550019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500bc020 con 0x7fe5580b58d0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5500b8670 con 0x7fe5580b58d0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500b8a40 con 0x7fe5580b58d0 2024-04-26T22:21:50.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5581497f0 con 0x7fe5580b58d0 2024-04-26T22:21:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5581473d0 con 0x7fe5580b58d0 2024-04-26T22:21:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe558069530 con 0x7fe5580b58d0 2024-04-26T22:21:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5500bf020 con 0x7fe5580b58d0 2024-04-26T22:21:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 0x7fe53406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe5501215d0 con 0x7fe5580b58d0 2024-04-26T22:21:50.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.799+0000 7fe556a00640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 0x7fe53406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:50.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.803+0000 7fe556a00640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 0x7fe53406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe548009b60 tx=0x7fe548009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:50.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.803+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe5500c6070 con 0x7fe5580b58d0 2024-04-26T22:21:50.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.971+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe558071200 con 0x7fe5580b58d0 2024-04-26T22:21:50.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.971+0000 7fe54f400640 1 -- 172.21.15.16:0/4154232512 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fe550016620 con 0x7fe5580b58d0 2024-04-26T22:21:50.976 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:50.976 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 msgr2=0x7fe53406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 0x7fe53406a870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe548009b60 tx=0x7fe548009190 comp rx=0 tx=0).stop 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 msgr2=0x7fe558148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe550009e50 tx=0x7fe550019710 comp rx=0 tx=0).stop 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 shutdown_connections 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe5340683b0 0x7fe53406a870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5580b58d0 0x7fe558148100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5580b0ac0 0x7fe558147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 --2- 172.21.15.16:0/4154232512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe55806e450 0x7fe558149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 >> 172.21.15.16:0/4154232512 conn(0x7fe5580b6620 msgr2=0x7fe5580b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 shutdown_connections 2024-04-26T22:21:50.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:50.975+0000 7fe55d800640 1 -- 172.21.15.16:0/4154232512 wait complete. 2024-04-26T22:21:50.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:50.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:51.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 Processor -- start 2024-04-26T22:21:51.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 -- start start 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febb40b0a30 0x7febb41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 0x7febb4146a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb4070480 con 0x7febb406e410 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7febb4070a60 con 0x7febb40b0a30 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb9600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7febb40718a0 con 0x7febb41406e0 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febb40b0a30 0x7febb41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febb40b0a30 0x7febb41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56690/0 (socket says 172.21.15.16:56690) 2024-04-26T22:21:51.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 -- 172.21.15.16:0/478739927 learned_addr learned my addr 172.21.15.16:0/478739927 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 -- 172.21.15.16:0/478739927 >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 msgr2=0x7febb4146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb3400640 1 --2- 172.21.15.16:0/478739927 >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 0x7febb4146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 --2- 172.21.15.16:0/478739927 >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 0x7febb4146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 -- 172.21.15.16:0/478739927 >> v1:172.21.15.195:6789/0 conn(0x7febb406e410 legacy=0x7febb413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febaa000640 1 -- 172.21.15.16:0/478739927 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb406e7f0 con 0x7febb40b0a30 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.139+0000 7febb3400640 1 --2- 172.21.15.16:0/478739927 >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 0x7febb4146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febaa000640 1 --2- 172.21.15.16:0/478739927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb41464e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7febb4146200 tx=0x7feb9c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75258f0b950ffc3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb2000640 1 -- 172.21.15.16:0/478739927 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0a7070 con 0x7febb40b0a30 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb2000640 1 -- 172.21.15.16:0/478739927 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c0b0070 con 0x7febb40b0a30 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb2000640 1 -- 172.21.15.16:0/478739927 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0ab890 con 0x7febb40b0a30 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 -- 172.21.15.16:0/478739927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 msgr2=0x7febb41464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 --2- 172.21.15.16:0/478739927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb41464e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7febb4146200 tx=0x7feb9c01c450 comp rx=0 tx=0).stop 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 -- 172.21.15.16:0/478739927 shutdown_connections 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 --2- 172.21.15.16:0/478739927 >> v2:172.21.15.195:3300/0 conn(0x7febb41406e0 0x7febb4146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 --2- 172.21.15.16:0/478739927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb41464e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 -- 172.21.15.16:0/478739927 >> 172.21.15.16:0/478739927 conn(0x7febb40b6590 msgr2=0x7febb40b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 -- 172.21.15.16:0/478739927 shutdown_connections 2024-04-26T22:21:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.143+0000 7febb9600640 1 -- 172.21.15.16:0/478739927 wait complete. 2024-04-26T22:21:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 Processor -- start 2024-04-26T22:21:51.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- start start 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 0x7febb413b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febb41406e0 0x7febb413e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7febb4153520 con 0x7febb40b0a30 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7febb41533a0 con 0x7febb406e410 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7febb41536a0 con 0x7febb41406e0 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb2a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 0x7febb413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56704/0 (socket says 172.21.15.16:56704) 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 -- 172.21.15.16:0/22409160 learned_addr learned my addr 172.21.15.16:0/22409160 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb3400640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febb41406e0 0x7febb413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 -- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febb41406e0 msgr2=0x7febb413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febb41406e0 0x7febb413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 -- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 msgr2=0x7febb413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 0x7febb413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 -- 172.21.15.16:0/22409160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb413d840 con 0x7febb40b0a30 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb2a00640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 0x7febb413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febaa000640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb9c01c930 tx=0x7feb9c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0b4800 con 0x7febb40b0a30 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c0b49a0 con 0x7febb40b0a30 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb413dac0 con 0x7febb40b0a30 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0b4d90 con 0x7febb40b0a30 2024-04-26T22:21:51.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb40732c0 con 0x7febb40b0a30 2024-04-26T22:21:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.147+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb4069530 con 0x7febb40b0a30 2024-04-26T22:21:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.151+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb9c0c7440 con 0x7febb40b0a30 2024-04-26T22:21:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.151+0000 7febab400640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.151+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feb9c121150 con 0x7febb40b0a30 2024-04-26T22:21:51.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.151+0000 7febb2a00640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.151+0000 7febb2a00640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 0x7feb9006a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feba4007fd0 tx=0x7feba4007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.155+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7febb413d840 con 0x7febb40b0a30 2024-04-26T22:21:51.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.319+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7febb413f7c0 con 0x7febb40b0a30 2024-04-26T22:21:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.319+0000 7febab400640 1 -- 172.21.15.16:0/22409160 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7feb9c0160d0 con 0x7febb40b0a30 2024-04-26T22:21:51.323 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 msgr2=0x7feb9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 0x7feb9006a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feba4007fd0 tx=0x7feba4007e40 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 msgr2=0x7febb413e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb9c01c930 tx=0x7feb9c01ac90 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 shutdown_connections 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb900683b0 0x7feb9006a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7febb41406e0 0x7febb413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b0a30 0x7febb413e440 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 --2- 172.21.15.16:0/22409160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7febb406e410 0x7febb413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 >> 172.21.15.16:0/22409160 conn(0x7febb40b6590 msgr2=0x7febb4144830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:51.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 shutdown_connections 2024-04-26T22:21:51.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.323+0000 7febb9600640 1 -- 172.21.15.16:0/22409160 wait complete. 2024-04-26T22:21:51.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:51.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.483+0000 7febac400640 1 Processor -- start 2024-04-26T22:21:51.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.483+0000 7febac400640 1 -- start start 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febac400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feba4073860 0x7feba4142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febac400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feba4142980 0x7feba4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febac400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba40a12d0 con 0x7feba40b7880 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febac400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7feba40b7210 con 0x7feba4073860 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febac400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7feba40b76a0 con 0x7feba4142980 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feba4073860 0x7feba4142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feba4073860 0x7feba4142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56706/0 (socket says 172.21.15.16:56706) 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 -- 172.21.15.16:0/3650598755 learned_addr learned my addr 172.21.15.16:0/3650598755 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7febaa400640 1 --2- 172.21.15.16:0/3650598755 >> v2:172.21.15.195:3300/0 conn(0x7feba4142980 0x7feba4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 -- 172.21.15.16:0/3650598755 >> v2:172.21.15.195:3300/0 conn(0x7feba4142980 msgr2=0x7feba4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 --2- 172.21.15.16:0/3650598755 >> v2:172.21.15.195:3300/0 conn(0x7feba4142980 0x7feba4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 -- 172.21.15.16:0/3650598755 >> v1:172.21.15.195:6789/0 conn(0x7feba40b7880 legacy=0x7feba4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.487+0000 7feba9a00640 1 -- 172.21.15.16:0/3650598755 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba40b6ed0 con 0x7feba4073860 2024-04-26T22:21:51.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7feba9a00640 1 --2- 172.21.15.16:0/3650598755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba4073860 0x7feba4142440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feba40b9c00 tx=0x7feb9801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63de4c921f7286e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7feba3e00640 1 -- 172.21.15.16:0/3650598755 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb980ab600 con 0x7feba4073860 2024-04-26T22:21:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7feba3e00640 1 -- 172.21.15.16:0/3650598755 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb980b0070 con 0x7feba4073860 2024-04-26T22:21:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7feba3e00640 1 -- 172.21.15.16:0/3650598755 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb980ab9c0 con 0x7feba4073860 2024-04-26T22:21:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- 172.21.15.16:0/3650598755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba4073860 msgr2=0x7feba4142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- 172.21.15.16:0/3650598755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba4073860 0x7feba4142440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feba40b9c00 tx=0x7feb9801c400 comp rx=0 tx=0).stop 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- 172.21.15.16:0/3650598755 shutdown_connections 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- 172.21.15.16:0/3650598755 >> v2:172.21.15.195:3300/0 conn(0x7feba4142980 0x7feba4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- 172.21.15.16:0/3650598755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba4073860 0x7feba4142440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- 172.21.15.16:0/3650598755 >> 172.21.15.16:0/3650598755 conn(0x7feba40b8850 msgr2=0x7feba40b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- 172.21.15.16:0/3650598755 shutdown_connections 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- 172.21.15.16:0/3650598755 wait complete. 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 Processor -- start 2024-04-26T22:21:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- start start 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba4073860 0x7feba406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba4142980 0x7feba41e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feba4071280 con 0x7feba413c8f0 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7feba4071100 con 0x7feba4073860 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febac400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7feba4070720 con 0x7feba4142980 2024-04-26T22:21:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.491+0000 7febaa400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56712/0 (socket says 172.21.15.16:56712) 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 -- 172.21.15.16:0/1976777915 learned_addr learned my addr 172.21.15.16:0/1976777915 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba9a00640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba4073860 0x7feba406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba9000640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba4142980 0x7feba41e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 -- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba4142980 msgr2=0x7feba41e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba4142980 0x7feba41e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 -- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba4073860 msgr2=0x7feba406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba4073860 0x7feba406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 -- 172.21.15.16:0/1976777915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba4147fa0 con 0x7feba413c8f0 2024-04-26T22:21:51.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febaa400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007e70 tx=0x7feb9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c014620 con 0x7feba413c8f0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c019070 con 0x7feba413c8f0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c014a20 con 0x7feba413c8f0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba41484f0 con 0x7feba413c8f0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba41e3a60 con 0x7feba413c8f0 2024-04-26T22:21:51.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba4069530 con 0x7feba413c8f0 2024-04-26T22:21:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb9c014bc0 con 0x7feba413c8f0 2024-04-26T22:21:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 0x7feb8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.495+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feb9c087240 con 0x7feba413c8f0 2024-04-26T22:21:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.499+0000 7feba9a00640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 0x7feb8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.499+0000 7feba9a00640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 0x7feb8406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb980af000 tx=0x7feb980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.499+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb9c0577f0 con 0x7feba413c8f0 2024-04-26T22:21:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.663+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feba406de60 con 0x7feba413c8f0 2024-04-26T22:21:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.663+0000 7feba1600640 1 -- 172.21.15.16:0/1976777915 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7feb9c0570f0 con 0x7feba413c8f0 2024-04-26T22:21:51.668 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 msgr2=0x7feb8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 0x7feb8406a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb980af000 tx=0x7feb980a7000 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 msgr2=0x7feba413cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7feb9c007e70 tx=0x7feb9c00e4b0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 shutdown_connections 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7feb84068380 0x7feb8406a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feba413c8f0 0x7feba413cda0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feba4142980 0x7feba41e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 --2- 172.21.15.16:0/1976777915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feba4073860 0x7feba406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 >> 172.21.15.16:0/1976777915 conn(0x7feba40b8850 msgr2=0x7feba40b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 shutdown_connections 2024-04-26T22:21:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.667+0000 7febac400640 1 -- 172.21.15.16:0/1976777915 wait complete. 2024-04-26T22:21:51.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 Processor -- start 2024-04-26T22:21:51.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 -- start start 2024-04-26T22:21:51.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5090073810 0x7f50900b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50900b8380 0x7f5090149f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 0x7f50900b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f509006f500 con 0x7f5090073810 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f509014a920 con 0x7f509014a490 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5096400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5090073bf0 con 0x7f50900b8380 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5090073810 0x7f50900b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5090073810 0x7f50900b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56728/0 (socket says 172.21.15.16:56728) 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 -- 172.21.15.16:0/3790414297 learned_addr learned my addr 172.21.15.16:0/3790414297 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508fe00640 1 --2- 172.21.15.16:0/3790414297 >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 0x7f50900b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f5086a00640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50900b8380 0x7f5090149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 -- 172.21.15.16:0/3790414297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50900b8380 msgr2=0x7f5090149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50900b8380 0x7f5090149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 -- 172.21.15.16:0/3790414297 >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 msgr2=0x7f50900b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 --2- 172.21.15.16:0/3790414297 >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 0x7f50900b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508f400640 1 -- 172.21.15.16:0/3790414297 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50900b1030 con 0x7f5090073810 2024-04-26T22:21:51.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.831+0000 7f508fe00640 1 --2- 172.21.15.16:0/3790414297 >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 0x7f50900b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:51.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f508f400640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5090073810 0x7f50900b7e40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50900b2b20 tx=0x7f508001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f60ea882a33e0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f508ea00640 1 -- 172.21.15.16:0/3790414297 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800b0070 con 0x7f5090073810 2024-04-26T22:21:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f508ea00640 1 -- 172.21.15.16:0/3790414297 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50800ab600 con 0x7f5090073810 2024-04-26T22:21:51.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f508ea00640 1 -- 172.21.15.16:0/3790414297 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50800ab9d0 con 0x7f5090073810 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 -- 172.21.15.16:0/3790414297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5090073810 msgr2=0x7f50900b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5090073810 0x7f50900b7e40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50900b2b20 tx=0x7f508001c1a0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 -- 172.21.15.16:0/3790414297 shutdown_connections 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 --2- 172.21.15.16:0/3790414297 >> v2:172.21.15.195:3300/0 conn(0x7f509014a490 0x7f50900b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f50900b8380 0x7f5090149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 --2- 172.21.15.16:0/3790414297 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5090073810 0x7f50900b7e40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 -- 172.21.15.16:0/3790414297 >> 172.21.15.16:0/3790414297 conn(0x7f50900bc570 msgr2=0x7f50900b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 -- 172.21.15.16:0/3790414297 shutdown_connections 2024-04-26T22:21:51.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.835+0000 7f5096400640 1 -- 172.21.15.16:0/3790414297 wait complete. 2024-04-26T22:21:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 Processor -- start 2024-04-26T22:21:51.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- start start 2024-04-26T22:21:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5090073810 0x7f50900b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50900b8380 0x7f509013c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5090071200 con 0x7f509014a490 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5090071080 con 0x7f50900b8380 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f509006f730 con 0x7f5090073810 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56738/0 (socket says 172.21.15.16:56738) 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 -- 172.21.15.16:0/2346131885 learned_addr learned my addr 172.21.15.16:0/2346131885 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508f400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5090073810 0x7f50900b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5086a00640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50900b8380 0x7f509013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 -- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5090073810 msgr2=0x7f50900b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5090073810 0x7f50900b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 -- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50900b8380 msgr2=0x7f509013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50900b8380 0x7f509013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 -- 172.21.15.16:0/2346131885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50900b4080 con 0x7f509014a490 2024-04-26T22:21:51.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f508fe00640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5088007ef0 tx=0x7f508800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508801a070 con 0x7f509014a490 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5088003ba0 con 0x7f509014a490 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50900baea0 con 0x7f509014a490 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088004030 con 0x7f509014a490 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50901492a0 con 0x7f509014a490 2024-04-26T22:21:51.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.839+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5090148a70 con 0x7f509014a490 2024-04-26T22:21:51.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.843+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f508801d070 con 0x7f509014a490 2024-04-26T22:21:51.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.843+0000 7f5087e00640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:51.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.843+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5088086b90 con 0x7f509014a490 2024-04-26T22:21:51.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.843+0000 7f508f400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:51.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.843+0000 7f508f400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 0x7f506c06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad000 tx=0x7f50800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:51.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:51.847+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5088010070 con 0x7f509014a490 2024-04-26T22:21:52.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.011+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5090069d00 con 0x7f509014a490 2024-04-26T22:21:52.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.011+0000 7f5087e00640 1 -- 172.21.15.16:0/2346131885 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5088056af0 con 0x7f509014a490 2024-04-26T22:21:52.015 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:52.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 msgr2=0x7f506c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 0x7f506c06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50800ad000 tx=0x7f50800a6000 comp rx=0 tx=0).stop 2024-04-26T22:21:52.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 msgr2=0x7f50901e1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5088007ef0 tx=0x7f508800d4a0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 shutdown_connections 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f506c068380 0x7f506c06a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f509014a490 0x7f50901e1f00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f50900b8380 0x7f509013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 --2- 172.21.15.16:0/2346131885 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5090073810 0x7f50900b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 >> 172.21.15.16:0/2346131885 conn(0x7f50900bc570 msgr2=0x7f50901403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 shutdown_connections 2024-04-26T22:21:52.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.015+0000 7f5096400640 1 -- 172.21.15.16:0/2346131885 wait complete. 2024-04-26T22:21:52.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:21:52.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 Processor -- start 2024-04-26T22:21:52.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 -- start start 2024-04-26T22:21:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 0x7f206c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f206c14c920 con 0x7f206c0b6dc0 2024-04-26T22:21:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f206c073c70 con 0x7f206c073890 2024-04-26T22:21:52.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.175+0000 7f2071200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f206c142d60 con 0x7f206c14bf60 2024-04-26T22:21:52.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 0x7f206c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 0x7f206c0b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:41688/0 (socket says 172.21.15.16:41688) 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2063e00640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f206c0b6dc0 0x7f206c142650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:38880/0 (socket says 172.21.15.16:38880) 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:55522/0 (socket says 172.21.15.16:55522) 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069e00640 1 -- 172.21.15.16:0/450779481 learned_addr learned my addr 172.21.15.16:0/450779481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 -- 172.21.15.16:0/450779481 >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 msgr2=0x7f206c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 --2- 172.21.15.16:0/450779481 >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 0x7f206c0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 -- 172.21.15.16:0/450779481 >> v1:172.21.15.195:6789/0 conn(0x7f206c0b6dc0 legacy=0x7f206c142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 -- 172.21.15.16:0/450779481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c0b7250 con 0x7f206c14bf60 2024-04-26T22:21:52.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f206a800640 1 --2- 172.21.15.16:0/450779481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2064009d90 tx=0x7f206401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3412a1a09618929b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069400640 1 -- 172.21.15.16:0/450779481 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20640b2070 con 0x7f206c14bf60 2024-04-26T22:21:52.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069400640 1 -- 172.21.15.16:0/450779481 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20640a5990 con 0x7f206c14bf60 2024-04-26T22:21:52.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.179+0000 7f2069400640 1 -- 172.21.15.16:0/450779481 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20640a5d60 con 0x7f206c14bf60 2024-04-26T22:21:52.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- 172.21.15.16:0/450779481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 msgr2=0x7f206c14c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- 172.21.15.16:0/450779481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2064009d90 tx=0x7f206401c8b0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- 172.21.15.16:0/450779481 shutdown_connections 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- 172.21.15.16:0/450779481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c14bf60 0x7f206c14c3e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- 172.21.15.16:0/450779481 >> v2:172.21.15.195:3300/0 conn(0x7f206c073890 0x7f206c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- 172.21.15.16:0/450779481 >> 172.21.15.16:0/450779481 conn(0x7f206c0b8850 msgr2=0x7f206c0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- 172.21.15.16:0/450779481 shutdown_connections 2024-04-26T22:21:52.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- 172.21.15.16:0/450779481 wait complete. 2024-04-26T22:21:52.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 Processor -- start 2024-04-26T22:21:52.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- start start 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c073890 0x7f206c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 0x7f206c13d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f206c155a60 con 0x7f206c14bf60 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1558e0 con 0x7f206c146790 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2071200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f206c155be0 con 0x7f206c073890 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56744/0 (socket says 172.21.15.16:56744) 2024-04-26T22:21:52.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 -- 172.21.15.16:0/959472185 learned_addr learned my addr 172.21.15.16:0/959472185 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2069e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c073890 0x7f206c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f206a800640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 0x7f206c13d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 -- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c073890 msgr2=0x7f206c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c073890 0x7f206c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 -- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 msgr2=0x7f206c13d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 0x7f206c13d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f2063e00640 1 -- 172.21.15.16:0/959472185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c1485f0 con 0x7f206c14bf60 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.183+0000 7f206a800640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 0x7f206c13d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2063e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f205400c420 tx=0x7f205400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540074e0 con 0x7f206c14bf60 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2054007680 con 0x7f206c14bf60 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054004a30 con 0x7f206c14bf60 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c149730 con 0x7f206c14bf60 2024-04-26T22:21:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c06d6e0 con 0x7f206c14bf60 2024-04-26T22:21:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206c148860 con 0x7f206c14bf60 2024-04-26T22:21:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f205401a020 con 0x7f206c14bf60 2024-04-26T22:21:52.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 0x7f204806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2054086160 con 0x7f206c14bf60 2024-04-26T22:21:52.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.187+0000 7f2069e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 0x7f204806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.191+0000 7f2069e00640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 0x7f204806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f206c149630 tx=0x7f205c009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.191+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f206c14c920 con 0x7f206c14bf60 2024-04-26T22:21:52.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f206c0b9df0 con 0x7f206c14bf60 2024-04-26T22:21:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2062000640 1 -- 172.21.15.16:0/959472185 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f2054056710 con 0x7f206c14bf60 2024-04-26T22:21:52.377 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 msgr2=0x7f204806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 0x7f204806a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f206c149630 tx=0x7f205c009240 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 msgr2=0x7f206c13cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f205400c420 tx=0x7f205400c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 shutdown_connections 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f2048068380 0x7f204806a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f206c146790 0x7f206c13d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f206c14bf60 0x7f206c13cfa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 --2- 172.21.15.16:0/959472185 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f206c073890 0x7f206c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 >> 172.21.15.16:0/959472185 conn(0x7f206c0b8850 msgr2=0x7f206c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 shutdown_connections 2024-04-26T22:21:52.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.375+0000 7f2071200640 1 -- 172.21.15.16:0/959472185 wait complete. 2024-04-26T22:21:52.399 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi016.front.sepia.ceph.com... 2024-04-26T22:21:52.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:52.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T22:21:52.429 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:21:52.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:21:52.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:21:52.430 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:21:52.489 INFO:tasks.cephfs.cephfs_test_case:[] 2024-04-26T22:21:52.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:52.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 Processor -- start 2024-04-26T22:21:52.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 -- start start 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba500b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba500b3f50 con 0x7fba500b58d0 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5006e830 con 0x7fba500b0ac0 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba56e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fba500b3310 con 0x7fba5006e450 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba47400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fba500b58d0 0x7fba50140060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36376/0 (socket says 172.21.15.16:36376) 2024-04-26T22:21:52.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.667+0000 7fba47400640 1 -- 172.21.15.16:0/2597270539 learned_addr learned my addr 172.21.15.16:0/2597270539 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:52.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba500b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152437941 0 0) 0x7fba500b3f50 con 0x7fba500b58d0 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba34003530 con 0x7fba500b58d0 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3977281763 0 0) 0x7fba34003530 con 0x7fba500b58d0 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 msgr2=0x7fba500b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba500b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 >> v1:172.21.15.195:6789/0 conn(0x7fba500b0ac0 legacy=0x7fba50150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba500b5f00 con 0x7fba500b58d0 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fba38001680 con 0x7fba500b58d0 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 >> v1:172.21.15.16:6789/0 conn(0x7fba500b58d0 legacy=0x7fba50140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba34003f70 0x7fba34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba500b3310 con 0x7fba34003f70 2024-04-26T22:21:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fba3400bb60 con 0x7fba34004d50 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fba3400bd60 con 0x7fba5006e450 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba34003f70 0x7fba34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba54e00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 -- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 msgr2=0x7fba340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 -- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34004d50 msgr2=0x7fba340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 -- 172.21.15.16:0/2597270539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba34003530 con 0x7fba34003f70 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba54e00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34004d50 0x7fba340051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:52.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba5006e450 0x7fba340039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:52.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.671+0000 7fba47400640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba34003f70 0x7fba34004810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c1c0 tx=0x7fba3801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777d9a45d0422d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38007d00 con 0x7fba34003f70 2024-04-26T22:21:52.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba380a9020 con 0x7fba34003f70 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba4f400640 1 -- 172.21.15.16:0/2597270539 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38005ae0 con 0x7fba34003f70 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- 172.21.15.16:0/2597270539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba34003f70 msgr2=0x7fba34004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 --2- 172.21.15.16:0/2597270539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba34003f70 0x7fba34004810 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fba3800c1c0 tx=0x7fba3801cc60 comp rx=0 tx=0).stop 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba54e00640 1 -- 172.21.15.16:0/2597270539 reap_dead start 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- 172.21.15.16:0/2597270539 shutdown_connections 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- 172.21.15.16:0/2597270539 >> 172.21.15.16:0/2597270539 conn(0x7fba500b6620 msgr2=0x7fba500b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- 172.21.15.16:0/2597270539 shutdown_connections 2024-04-26T22:21:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- 172.21.15.16:0/2597270539 wait complete. 2024-04-26T22:21:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 Processor -- start 2024-04-26T22:21:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- start start 2024-04-26T22:21:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34003f70 0x7fba501d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba501e11f0 0x7fba5013d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba500b1830 con 0x7fba5013e580 2024-04-26T22:21:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fba500b3c80 con 0x7fba34003f70 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba56e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fba500b19b0 con 0x7fba501e11f0 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56752/0 (socket says 172.21.15.16:56752) 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 -- 172.21.15.16:0/2538211098 learned_addr learned my addr 172.21.15.16:0/2538211098 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34003f70 0x7fba501d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba54e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba501e11f0 0x7fba5013d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 -- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba501e11f0 msgr2=0x7fba5013d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba501e11f0 0x7fba5013d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 -- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34003f70 msgr2=0x7fba501d40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34003f70 0x7fba501d40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 -- 172.21.15.16:0/2538211098 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba50149140 con 0x7fba5013e580 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.675+0000 7fba47400640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba38007040 tx=0x7fba34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38007d00 con 0x7fba5013e580 2024-04-26T22:21:52.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38000ee0 con 0x7fba5013e580 2024-04-26T22:21:52.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38001c40 con 0x7fba5013e580 2024-04-26T22:21:52.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba50147e80 con 0x7fba5013e580 2024-04-26T22:21:52.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba50141ef0 con 0x7fba5013e580 2024-04-26T22:21:52.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba50069530 con 0x7fba5013e580 2024-04-26T22:21:52.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba380a5a30 con 0x7fba5013e580 2024-04-26T22:21:52.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 0x7fba2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:52.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fba381202b0 con 0x7fba5013e580 2024-04-26T22:21:52.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.679+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 0x7fba2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:52.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.683+0000 7fba4fe00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 0x7fba2c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ab0 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:52.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.687+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba38016970 con 0x7fba5013e580 2024-04-26T22:21:52.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba50144f10 con 0x7fba5013e580 2024-04-26T22:21:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba4cc00640 1 -- 172.21.15.16:0/2538211098 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fba380c03a0 con 0x7fba5013e580 2024-04-26T22:21:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:52.885 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:52.885 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 msgr2=0x7fba2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 0x7fba2c06a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ab0 tx=0x7fba40008040 comp rx=0 tx=0).stop 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 msgr2=0x7fba501e0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba38007040 tx=0x7fba34005840 comp rx=0 tx=0).stop 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 shutdown_connections 2024-04-26T22:21:52.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fba2c068380 0x7fba2c06a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba501e11f0 0x7fba5013d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba5013e580 0x7fba501e0cb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 --2- 172.21.15.16:0/2538211098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba34003f70 0x7fba501d40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 >> 172.21.15.16:0/2538211098 conn(0x7fba500b6620 msgr2=0x7fba5013fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 shutdown_connections 2024-04-26T22:21:52.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:52.883+0000 7fba56e00640 1 -- 172.21.15.16:0/2538211098 wait complete. 2024-04-26T22:21:52.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 Processor -- start 2024-04-26T22:21:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 -- start start 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fae50146a30 0x7fae50146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 0x7fae50151010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500b58e0 con 0x7fae50075a70 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fae500b67a0 con 0x7fae50146a30 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.043+0000 7fae55600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fae500b5bc0 con 0x7fae5014ec20 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fae50075a70 0x7fae501402f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36378/0 (socket says 172.21.15.16:36378) 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4ea00640 1 -- 172.21.15.16:0/235577033 learned_addr learned my addr 172.21.15.16:0/235577033 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 --2- 172.21.15.16:0/235577033 >> v2:172.21.15.16:3300/0 conn(0x7fae50146a30 0x7fae50146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4e000640 1 -- 172.21.15.16:0/235577033 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399405356 0 0) 0x7fae500b58e0 con 0x7fae50075a70 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4e000640 1 -- 172.21.15.16:0/235577033 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae34003530 con 0x7fae50075a70 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 -- 172.21.15.16:0/235577033 >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 msgr2=0x7fae50151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4f400640 1 --2- 172.21.15.16:0/235577033 >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 0x7fae50151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 --2- 172.21.15.16:0/235577033 >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 0x7fae50151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 -- 172.21.15.16:0/235577033 >> v1:172.21.15.16:6789/0 conn(0x7fae50075a70 legacy=0x7fae501402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 -- 172.21.15.16:0/235577033 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae50146510 con 0x7fae50146a30 2024-04-26T22:21:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4f400640 1 --2- 172.21.15.16:0/235577033 >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 0x7fae50151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:21:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae46000640 1 --2- 172.21.15.16:0/235577033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50146a30 0x7fae50146ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fae500b79c0 tx=0x7fae3801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52554ee9f40be8b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4e000640 1 -- 172.21.15.16:0/235577033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae380b2070 con 0x7fae50146a30 2024-04-26T22:21:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4e000640 1 -- 172.21.15.16:0/235577033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae380ad680 con 0x7fae50146a30 2024-04-26T22:21:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.047+0000 7fae4e000640 1 -- 172.21.15.16:0/235577033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae380ada50 con 0x7fae50146a30 2024-04-26T22:21:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- 172.21.15.16:0/235577033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50146a30 msgr2=0x7fae50146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- 172.21.15.16:0/235577033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50146a30 0x7fae50146ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fae500b79c0 tx=0x7fae3801c3a0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- 172.21.15.16:0/235577033 shutdown_connections 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- 172.21.15.16:0/235577033 >> v2:172.21.15.195:3300/0 conn(0x7fae5014ec20 0x7fae50151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- 172.21.15.16:0/235577033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50146a30 0x7fae50146ee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- 172.21.15.16:0/235577033 >> 172.21.15.16:0/235577033 conn(0x7fae500b6de0 msgr2=0x7fae500b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- 172.21.15.16:0/235577033 shutdown_connections 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- 172.21.15.16:0/235577033 wait complete. 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 Processor -- start 2024-04-26T22:21:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- start start 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae50146a30 0x7fae50072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae5014ec20 0x7fae500725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae50140a00 con 0x7fae50075a70 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fae500b5580 con 0x7fae50146a30 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae55600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fae500b4ce0 con 0x7fae5014ec20 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56780/0 (socket says 172.21.15.16:56780) 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 -- 172.21.15.16:0/2407902719 learned_addr learned my addr 172.21.15.16:0/2407902719 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:53.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae46000640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae50146a30 0x7fae50072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4f400640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae5014ec20 0x7fae500725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 -- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae5014ec20 msgr2=0x7fae500725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae5014ec20 0x7fae500725c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 -- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae50146a30 msgr2=0x7fae50072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae50146a30 0x7fae50072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 -- 172.21.15.16:0/2407902719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae50073750 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae4ea00640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c3c0 tx=0x7fae4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40017070 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae40005cf0 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.051+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae400072f0 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae50071b80 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae501406c0 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae50069530 con 0x7fae50075a70 2024-04-26T22:21:53.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae4001a070 con 0x7fae50075a70 2024-04-26T22:21:53.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae47400640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 0x7fae2c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fae40085cc0 con 0x7fae50075a70 2024-04-26T22:21:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae46000640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 0x7fae2c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.055+0000 7fae46000640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 0x7fae2c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae380af000 tx=0x7fae38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.059+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae40056310 con 0x7fae50075a70 2024-04-26T22:21:53.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.227+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae500b6430 con 0x7fae50075a70 2024-04-26T22:21:53.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.227+0000 7fae47400640 1 -- 172.21.15.16:0/2407902719 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fae40055c10 con 0x7fae50075a70 2024-04-26T22:21:53.230 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:53.230 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 msgr2=0x7fae2c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 0x7fae2c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fae380af000 tx=0x7fae38008040 comp rx=0 tx=0).stop 2024-04-26T22:21:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 msgr2=0x7fae50143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c3c0 tx=0x7fae4000c880 comp rx=0 tx=0).stop 2024-04-26T22:21:53.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 shutdown_connections 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fae2c0683b0 0x7fae2c06a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fae5014ec20 0x7fae500725c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae50146a30 0x7fae50072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 --2- 172.21.15.16:0/2407902719 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae50075a70 0x7fae50143500 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 >> 172.21.15.16:0/2407902719 conn(0x7fae500b6de0 msgr2=0x7fae500b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 shutdown_connections 2024-04-26T22:21:53.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.231+0000 7fae55600640 1 -- 172.21.15.16:0/2407902719 wait complete. 2024-04-26T22:21:53.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:21:20.082070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:21:20.739294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:21:53.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:21:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 Processor -- start 2024-04-26T22:21:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 -- start start 2024-04-26T22:21:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 0x7f7e6806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e680a09a0 0x7f7e680709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 0x7f7e68148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7e680a0510 con 0x7f7e680a09a0 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7e680a0e00 con 0x7f7e68070ef0 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e68073bf0 con 0x7f7e68073810 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e680a09a0 0x7f7e680709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 0x7f7e68148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 0x7f7e6806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e680a09a0 0x7f7e680709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56790/0 (socket says 172.21.15.16:56790) 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 -- 172.21.15.16:0/1118976018 learned_addr learned my addr 172.21.15.16:0/1118976018 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 0x7f7e6806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:55586/0 (socket says 172.21.15.16:55586) 2024-04-26T22:21:53.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e6d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 0x7f7e68148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:41748/0 (socket says 172.21.15.16:41748) 2024-04-26T22:21:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 -- 172.21.15.16:0/1118976018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 msgr2=0x7f7e6806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 --2- 172.21.15.16:0/1118976018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 0x7f7e6806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 -- 172.21.15.16:0/1118976018 >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 msgr2=0x7f7e68148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 --2- 172.21.15.16:0/1118976018 >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 0x7f7e68148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.395+0000 7f7e67e00640 1 -- 172.21.15.16:0/1118976018 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6809fec0 con 0x7f7e680a09a0 2024-04-26T22:21:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e67e00640 1 --2- 172.21.15.16:0/1118976018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e680a09a0 0x7f7e680709b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e68146120 tx=0x7f7e5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2c538b47ba227 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e67400640 1 -- 172.21.15.16:0/1118976018 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540b0070 con 0x7f7e680a09a0 2024-04-26T22:21:53.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e67400640 1 -- 172.21.15.16:0/1118976018 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540ab600 con 0x7f7e680a09a0 2024-04-26T22:21:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e67400640 1 -- 172.21.15.16:0/1118976018 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540ab9d0 con 0x7f7e680a09a0 2024-04-26T22:21:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 -- 172.21.15.16:0/1118976018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e680a09a0 msgr2=0x7f7e680709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 --2- 172.21.15.16:0/1118976018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e680a09a0 0x7f7e680709b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e68146120 tx=0x7f7e5401c520 comp rx=0 tx=0).stop 2024-04-26T22:21:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 -- 172.21.15.16:0/1118976018 shutdown_connections 2024-04-26T22:21:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 --2- 172.21.15.16:0/1118976018 >> v2:172.21.15.195:3300/0 conn(0x7f7e68070ef0 0x7f7e68148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 --2- 172.21.15.16:0/1118976018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e680a09a0 0x7f7e680709b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 --2- 172.21.15.16:0/1118976018 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e68073810 0x7f7e6806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 -- 172.21.15.16:0/1118976018 >> 172.21.15.16:0/1118976018 conn(0x7f7e680bc570 msgr2=0x7f7e680b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 -- 172.21.15.16:0/1118976018 shutdown_connections 2024-04-26T22:21:53.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.399+0000 7f7e6f800640 1 -- 172.21.15.16:0/1118976018 wait complete. 2024-04-26T22:21:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 Processor -- start 2024-04-26T22:21:53.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- start start 2024-04-26T22:21:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e68073810 0x7f7e6813d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e680a09a0 0x7f7e6806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6814c600 con 0x7f7e68070ef0 2024-04-26T22:21:53.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6814c480 con 0x7f7e68073810 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6814c780 con 0x7f7e680a09a0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56798/0 (socket says 172.21.15.16:56798) 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 -- 172.21.15.16:0/210871426 learned_addr learned my addr 172.21.15.16:0/210871426 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e67e00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e68073810 0x7f7e6813d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6d800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e680a09a0 0x7f7e6806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 -- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e680a09a0 msgr2=0x7f7e6806dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e680a09a0 0x7f7e6806dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 -- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e68073810 msgr2=0x7f7e6813d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e68073810 0x7f7e6813d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 -- 172.21.15.16:0/210871426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e68148270 con 0x7f7e68070ef0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6ce00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e960 tx=0x7f7e5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c017070 con 0x7f7e68070ef0 2024-04-26T22:21:53.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00ca00 con 0x7f7e68070ef0 2024-04-26T22:21:53.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00cdb0 con 0x7f7e68070ef0 2024-04-26T22:21:53.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6813e130 con 0x7f7e68070ef0 2024-04-26T22:21:53.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.403+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e68146860 con 0x7f7e68070ef0 2024-04-26T22:21:53.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e68069530 con 0x7f7e68070ef0 2024-04-26T22:21:53.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e5c01a070 con 0x7f7e68070ef0 2024-04-26T22:21:53.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e64c00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 0x7f7e4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c086bb0 con 0x7f7e68070ef0 2024-04-26T22:21:53.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e67e00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 0x7f7e4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.407+0000 7f7e67e00640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 0x7f7e4806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e540ad000 tx=0x7f7e54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.411+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e5c056bb0 con 0x7f7e68070ef0 2024-04-26T22:21:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.575+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7e68149d90 con 0x7f7e68070ef0 2024-04-26T22:21:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.575+0000 7f7e64c00640 1 -- 172.21.15.16:0/210871426 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f7e5c05aeb0 con 0x7f7e68070ef0 2024-04-26T22:21:53.580 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:21:53.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 msgr2=0x7f7e4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 0x7f7e4806a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e540ad000 tx=0x7f7e54008040 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 msgr2=0x7f7e681e4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e960 tx=0x7f7e5c00ee20 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 shutdown_connections 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7e48068380 0x7f7e4806a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e680a09a0 0x7f7e6806dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e68073810 0x7f7e6813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 --2- 172.21.15.16:0/210871426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e68070ef0 0x7f7e681e4350 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 >> 172.21.15.16:0/210871426 conn(0x7f7e680bc570 msgr2=0x7f7e68072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 shutdown_connections 2024-04-26T22:21:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.579+0000 7f7e6f800640 1 -- 172.21.15.16:0/210871426 wait complete. 2024-04-26T22:21:53.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:21:53.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 Processor -- start 2024-04-26T22:21:53.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 -- start start 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f344c1464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f344c1406e0 0x7f344c146a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f344c070480 con 0x7f344c06e410 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f344c070a60 con 0x7f344c1406e0 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3453e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f344c0718a0 con 0x7f344c0b0a30 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3451400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f344c06e410 0x7f344c13ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36380/0 (socket says 172.21.15.16:36380) 2024-04-26T22:21:53.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3451400640 1 -- 172.21.15.16:0/45665341 learned_addr learned my addr 172.21.15.16:0/45665341 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:53.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f344c1464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3451e00640 1 --2- 172.21.15.16:0/45665341 >> v2:172.21.15.195:3300/0 conn(0x7f344c1406e0 0x7f344c146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493233217 0 0) 0x7f344c070480 con 0x7f344c06e410 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3434003530 con 0x7f344c06e410 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2642185994 0 0) 0x7f3434003530 con 0x7f344c06e410 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 msgr2=0x7f344c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f344c1464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 >> v2:172.21.15.195:3300/0 conn(0x7f344c1406e0 msgr2=0x7f344c146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 --2- 172.21.15.16:0/45665341 >> v2:172.21.15.195:3300/0 conn(0x7f344c1406e0 0x7f344c146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c06e7f0 con 0x7f344c06e410 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f3440001680 con 0x7f344c06e410 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 >> v1:172.21.15.16:6789/0 conn(0x7f344c06e410 legacy=0x7f344c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34340039c0 0x7f3434003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f3434004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f34340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f344c070a60 con 0x7f3434004810 2024-04-26T22:21:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0718a0 con 0x7f34340039c0 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f343400b9d0 con 0x7f344c0b0a30 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f3434004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3451400640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34340039c0 0x7f3434003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3451e00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f34340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 -- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 msgr2=0x7f34340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b0a30 0x7f34340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 -- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34340039c0 msgr2=0x7f3434003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f34340039c0 0x7f3434003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.743+0000 7f3450a00640 1 -- 172.21.15.16:0/45665341 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3434003530 con 0x7f3434004810 2024-04-26T22:21:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3450a00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f3434004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3438009b10 tx=0x7f343801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0d9aca3e2830aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380096b0 con 0x7f3434004810 2024-04-26T22:21:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380a6480 con 0x7f3434004810 2024-04-26T22:21:53.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f344be00640 1 -- 172.21.15.16:0/45665341 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380a6870 con 0x7f3434004810 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 -- 172.21.15.16:0/45665341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 msgr2=0x7f3434004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 --2- 172.21.15.16:0/45665341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f3434004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3438009b10 tx=0x7f343801ca70 comp rx=0 tx=0).stop 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3451e00640 1 -- 172.21.15.16:0/45665341 reap_dead start 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 -- 172.21.15.16:0/45665341 shutdown_connections 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 -- 172.21.15.16:0/45665341 >> 172.21.15.16:0/45665341 conn(0x7f344c0b6590 msgr2=0x7f344c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 -- 172.21.15.16:0/45665341 shutdown_connections 2024-04-26T22:21:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.747+0000 7f3453e00640 1 -- 172.21.15.16:0/45665341 wait complete. 2024-04-26T22:21:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 Processor -- start 2024-04-26T22:21:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- start start 2024-04-26T22:21:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c14c0a0 0x7f344c13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b2460 0x7f344c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f344c151510 con 0x7f3434004810 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f344c151390 con 0x7f344c14c0a0 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f344c151690 con 0x7f344c0b2460 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56804/0 (socket says 172.21.15.16:56804) 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 -- 172.21.15.16:0/356093867 learned_addr learned my addr 172.21.15.16:0/356093867 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3450a00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c14c0a0 0x7f344c13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b2460 0x7f344c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 -- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b2460 msgr2=0x7f344c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b2460 0x7f344c0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 -- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c14c0a0 msgr2=0x7f344c13ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c14c0a0 0x7f344c13ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 -- 172.21.15.16:0/356093867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c13e8c0 con 0x7f3434004810 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3451400640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3440004fa0 tx=0x7f34400074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440007740 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3440018070 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344000fb50 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c13f650 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c13c820 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.751+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c14bbd0 con 0x7f3434004810 2024-04-26T22:21:53.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.755+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f344000fcf0 con 0x7f3434004810 2024-04-26T22:21:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.755+0000 7f3449600640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 0x7f342c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.755+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3440086860 con 0x7f3434004810 2024-04-26T22:21:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.755+0000 7f3450a00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 0x7f342c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.755+0000 7f3450a00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 0x7f342c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34380ad000 tx=0x7f34380b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:53.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.759+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f34400567c0 con 0x7f3434004810 2024-04-26T22:21:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f344c069530 con 0x7f3434004810 2024-04-26T22:21:53.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3449600640 1 -- 172.21.15.16:0/356093867 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f344005aac0 con 0x7f3434004810 2024-04-26T22:21:53.925 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 msgr2=0x7f342c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 0x7f342c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34380ad000 tx=0x7f34380b3040 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 msgr2=0x7f344c13efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3440004fa0 tx=0x7f34400074f0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 shutdown_connections 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f342c0683b0 0x7f342c06a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f344c0b2460 0x7f344c0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f344c14c0a0 0x7f344c13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 --2- 172.21.15.16:0/356093867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3434004810 0x7f344c13efc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 >> 172.21.15.16:0/356093867 conn(0x7f344c0b6590 msgr2=0x7f344c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 shutdown_connections 2024-04-26T22:21:53.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:53.923+0000 7f3453e00640 1 -- 172.21.15.16:0/356093867 wait complete. 2024-04-26T22:21:53.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:21:54.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 Processor -- start 2024-04-26T22:21:54.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 -- start start 2024-04-26T22:21:54.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c06e410 0x7efe3c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe3c1465c0 0x7efe3c149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c06e7f0 con 0x7efe3c13eec0 2024-04-26T22:21:54.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c070a40 con 0x7efe3c1465c0 2024-04-26T22:21:54.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe41800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c070760 con 0x7efe3c06e410 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe3a000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe3c1465c0 0x7efe3c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe3b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efe3c13eec0 0x7efe3c13f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36382/0 (socket says 172.21.15.16:36382) 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe3b400640 1 -- 172.21.15.16:0/2794446294 learned_addr learned my addr 172.21.15.16:0/2794446294 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.087+0000 7efe3aa00640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c06e410 0x7efe3c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe39600640 1 -- 172.21.15.16:0/2794446294 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426441594 0 0) 0x7efe3c06e7f0 con 0x7efe3c13eec0 2024-04-26T22:21:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe39600640 1 -- 172.21.15.16:0/2794446294 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe20003530 con 0x7efe3c13eec0 2024-04-26T22:21:54.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe3a000640 1 -- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c06e410 msgr2=0x7efe3c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:54.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe3a000640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c06e410 0x7efe3c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe3a000640 1 -- 172.21.15.16:0/2794446294 >> v1:172.21.15.16:6789/0 conn(0x7efe3c13eec0 legacy=0x7efe3c13f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe3a000640 1 -- 172.21.15.16:0/2794446294 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c148860 con 0x7efe3c1465c0 2024-04-26T22:21:54.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe3a000640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c149060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe280097c0 tx=0x7efe2801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded71506f9f21e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe39600640 1 -- 172.21.15.16:0/2794446294 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280b0070 con 0x7efe3c1465c0 2024-04-26T22:21:54.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe39600640 1 -- 172.21.15.16:0/2794446294 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe280ab600 con 0x7efe3c1465c0 2024-04-26T22:21:54.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe39600640 1 -- 172.21.15.16:0/2794446294 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280ab9d0 con 0x7efe3c1465c0 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 -- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 msgr2=0x7efe3c149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c149060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe280097c0 tx=0x7efe2801c410 comp rx=0 tx=0).stop 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 -- 172.21.15.16:0/2794446294 shutdown_connections 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c149060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 --2- 172.21.15.16:0/2794446294 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c06e410 0x7efe3c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.091+0000 7efe41800640 1 -- 172.21.15.16:0/2794446294 >> 172.21.15.16:0/2794446294 conn(0x7efe3c0b6590 msgr2=0x7efe3c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- 172.21.15.16:0/2794446294 shutdown_connections 2024-04-26T22:21:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- 172.21.15.16:0/2794446294 wait complete. 2024-04-26T22:21:54.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 Processor -- start 2024-04-26T22:21:54.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- start start 2024-04-26T22:21:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c13eec0 0x7efe3c072e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c152600 con 0x7efe3c06e410 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c152480 con 0x7efe3c1465c0 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c152780 con 0x7efe3c13eec0 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56806/0 (socket says 172.21.15.16:56806) 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 -- 172.21.15.16:0/2244870520 learned_addr learned my addr 172.21.15.16:0/2244870520 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3a000640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c13eec0 0x7efe3c072e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3b400640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 -- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c13eec0 msgr2=0x7efe3c072e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c13eec0 0x7efe3c072e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 -- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 msgr2=0x7efe3c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 -- 172.21.15.16:0/2244870520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0734a0 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3b400640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe3aa00640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e870 tx=0x7efe2c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c017070 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c00c940 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00ccf0 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c1e0d50 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.095+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c073cb0 con 0x7efe3c06e410 2024-04-26T22:21:54.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.099+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c069530 con 0x7efe3c06e410 2024-04-26T22:21:54.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.099+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe2c01a070 con 0x7efe3c06e410 2024-04-26T22:21:54.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.099+0000 7efe32a00640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.099+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efe2c086ba0 con 0x7efe3c06e410 2024-04-26T22:21:54.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.099+0000 7efe3a000640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.103+0000 7efe3a000640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 0x7efe1c06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe280ad000 tx=0x7efe28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.103+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe2c056b00 con 0x7efe3c06e410 2024-04-26T22:21:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efe3c142b30 con 0x7efe3c06e410 2024-04-26T22:21:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe32a00640 1 -- 172.21.15.16:0/2244870520 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7efe2c05ae00 con 0x7efe3c06e410 2024-04-26T22:21:54.274 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 msgr2=0x7efe1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 0x7efe1c06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efe280ad000 tx=0x7efe28008040 comp rx=0 tx=0).stop 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 msgr2=0x7efe3c13f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.271+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e870 tx=0x7efe2c00ec70 comp rx=0 tx=0).stop 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 shutdown_connections 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7efe1c068380 0x7efe1c06a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe3c1465c0 0x7efe3c145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe3c13eec0 0x7efe3c072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 --2- 172.21.15.16:0/2244870520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe3c06e410 0x7efe3c13f7d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 >> 172.21.15.16:0/2244870520 conn(0x7efe3c0b6590 msgr2=0x7efe3c06d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 shutdown_connections 2024-04-26T22:21:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.275+0000 7efe41800640 1 -- 172.21.15.16:0/2244870520 wait complete. 2024-04-26T22:21:54.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.435+0000 7f0947200640 1 Processor -- start 2024-04-26T22:21:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.435+0000 7f0947200640 1 -- start start 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0947200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f094814ade0 0x7f094814b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0947200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f0948153100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0947200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09480afbf0 con 0x7f09480b6710 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0947200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f09480b6af0 con 0x7f094814ade0 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0947200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f09480b71e0 con 0x7f0948150d10 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f09480b6710 0x7f09480b02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36386/0 (socket says 172.21.15.16:36386) 2024-04-26T22:21:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945e00640 1 -- 172.21.15.16:0/3345345020 learned_addr learned my addr 172.21.15.16:0/3345345020 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:54.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> v2:172.21.15.195:3300/0 conn(0x7f094814ade0 0x7f094814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0946800640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f0948153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984331264 0 0) 0x7f09480afbf0 con 0x7f09480b6710 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f092c003530 con 0x7f09480b6710 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1360582567 0 0) 0x7f092c003530 con 0x7f09480b6710 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 msgr2=0x7f0948153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f0948153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 >> v2:172.21.15.195:3300/0 conn(0x7f094814ade0 msgr2=0x7f094814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 --2- 172.21.15.16:0/3345345020 >> v2:172.21.15.195:3300/0 conn(0x7f094814ade0 0x7f094814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094814b7b0 con 0x7f09480b6710 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f0938001680 con 0x7f09480b6710 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 >> v1:172.21.15.16:6789/0 conn(0x7f09480b6710 legacy=0x7f09480b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f092c0039c0 0x7f092c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f092c004810 0x7f092c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f092c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09480b6af0 con 0x7f092c004810 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f09480b71e0 con 0x7f092c0039c0 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f092c00b9d0 con 0x7f0948150d10 2024-04-26T22:21:54.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> v2:172.21.15.195:3300/0 conn(0x7f094814ade0 0x7f094814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f092c004810 0x7f092c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0945e00640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f092c0039c0 0x7f092c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f0946800640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f092c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 -- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 msgr2=0x7f092c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0948150d10 0x7f092c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 -- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f092c0039c0 msgr2=0x7f092c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f092c0039c0 0x7f092c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.439+0000 7f093d400640 1 -- 172.21.15.16:0/3345345020 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c003530 con 0x7f092c004810 2024-04-26T22:21:54.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f093d400640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f092c004810 0x7f092c004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f093000e380 tx=0x7f093001ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22e9487777b9d57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930009dc0 con 0x7f092c004810 2024-04-26T22:21:54.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300a5d20 con 0x7f092c004810 2024-04-26T22:21:54.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0945400640 1 -- 172.21.15.16:0/3345345020 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930003ba0 con 0x7f092c004810 2024-04-26T22:21:54.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 -- 172.21.15.16:0/3345345020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f092c004810 msgr2=0x7f092c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 --2- 172.21.15.16:0/3345345020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f092c004810 0x7f092c004c90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f093000e380 tx=0x7f093001ce10 comp rx=0 tx=0).stop 2024-04-26T22:21:54.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0946800640 1 -- 172.21.15.16:0/3345345020 reap_dead start 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 -- 172.21.15.16:0/3345345020 shutdown_connections 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 -- 172.21.15.16:0/3345345020 >> 172.21.15.16:0/3345345020 conn(0x7f09480b75a0 msgr2=0x7f09480b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 -- 172.21.15.16:0/3345345020 shutdown_connections 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.443+0000 7f0947200640 1 -- 172.21.15.16:0/3345345020 wait complete. 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 Processor -- start 2024-04-26T22:21:54.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- start start 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f092c004810 0x7f09480b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0948148b80 0x7f0948145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f094806f5c0 con 0x7f09481460f0 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f09480afe60 con 0x7f0948148b80 2024-04-26T22:21:54.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f09480a0220 con 0x7f092c004810 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56818/0 (socket says 172.21.15.16:56818) 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 -- 172.21.15.16:0/2363297710 learned_addr learned my addr 172.21.15.16:0/2363297710 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0945e00640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f092c004810 0x7f09480b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f093d400640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0948148b80 0x7f0948145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 -- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f092c004810 msgr2=0x7f09480b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f092c004810 0x7f09480b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 -- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0948148b80 msgr2=0x7f0948145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0948148b80 0x7f0948145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 -- 172.21.15.16:0/2363297710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0948147060 con 0x7f09481460f0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0946800640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f09480712e0 tx=0x7f0940011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940019020 con 0x7f09481460f0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940004240 con 0x7f09481460f0 2024-04-26T22:21:54.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094000f770 con 0x7f09481460f0 2024-04-26T22:21:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0948146570 con 0x7f09481460f0 2024-04-26T22:21:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09480b2ed0 con 0x7f09481460f0 2024-04-26T22:21:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.447+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094806d390 con 0x7f09481460f0 2024-04-26T22:21:54.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.451+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f094001c020 con 0x7f09481460f0 2024-04-26T22:21:54.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.451+0000 7f093ea00640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 0x7f092406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.451+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0940086b10 con 0x7f09481460f0 2024-04-26T22:21:54.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.451+0000 7f0945e00640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 0x7f092406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.451+0000 7f0945e00640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 0x7f092406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09380015e0 tx=0x7f0938007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.455+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0940023020 con 0x7f09481460f0 2024-04-26T22:21:54.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f094806fe00 con 0x7f09481460f0 2024-04-26T22:21:54.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f093ea00640 1 -- 172.21.15.16:0/2363297710 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f0948146570 con 0x7f09481460f0 2024-04-26T22:21:54.657 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:54.657 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:54.657 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 msgr2=0x7f092406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 0x7f092406a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09380015e0 tx=0x7f0938007900 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 msgr2=0x7f094813ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f09480712e0 tx=0x7f0940011cf0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 shutdown_connections 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0924068380 0x7f092406a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09481460f0 0x7f094813ec90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0948148b80 0x7f0948145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 --2- 172.21.15.16:0/2363297710 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f092c004810 0x7f09480b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 >> 172.21.15.16:0/2363297710 conn(0x7f09480b75a0 msgr2=0x7f09480689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 shutdown_connections 2024-04-26T22:21:54.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.655+0000 7f0947200640 1 -- 172.21.15.16:0/2363297710 wait complete. 2024-04-26T22:21:54.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:54.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.815+0000 7f0390200640 1 Processor -- start 2024-04-26T22:21:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.815+0000 7f0390200640 1 -- start start 2024-04-26T22:21:54.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0390200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f038806e450 0x7f03880b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0390200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038806e830 con 0x7f038814dac0 2024-04-26T22:21:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0390200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03880b0a30 con 0x7f038813ef30 2024-04-26T22:21:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0390200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f03880b0d10 con 0x7f038806e450 2024-04-26T22:21:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038e200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f038814dac0 0x7f038814feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44386/0 (socket says 172.21.15.16:44386) 2024-04-26T22:21:54.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038e200640 1 -- 172.21.15.16:0/3357008177 learned_addr learned my addr 172.21.15.16:0/3357008177 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038d800640 1 --2- 172.21.15.16:0/3357008177 >> v2:172.21.15.195:3300/0 conn(0x7f038806e450 0x7f03880b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039156834 0 0) 0x7f038806e830 con 0x7f038814dac0 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0370003530 con 0x7f038814dac0 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3579868926 0 0) 0x7f0370003530 con 0x7f038814dac0 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038d800640 1 -- 172.21.15.16:0/3357008177 >> v1:172.21.15.195:6789/0 conn(0x7f038813ef30 legacy=0x7f038813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038d800640 1 -- 172.21.15.16:0/3357008177 >> v1:172.21.15.16:6789/0 conn(0x7f038814dac0 legacy=0x7f038814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.819+0000 7f038d800640 1 -- 172.21.15.16:0/3357008177 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03880b2cf0 con 0x7f038806e450 2024-04-26T22:21:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f038d800640 1 --2- 172.21.15.16:0/3357008177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038806e450 0x7f03880b1020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097c0 tx=0x7f037c01c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e8362da6dcb2b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0b0070 con 0x7f038806e450 2024-04-26T22:21:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c0ab400 con 0x7f038806e450 2024-04-26T22:21:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0387e00640 1 -- 172.21.15.16:0/3357008177 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380001a00 con 0x7f038806e450 2024-04-26T22:21:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- 172.21.15.16:0/3357008177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038806e450 msgr2=0x7f03880b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 --2- 172.21.15.16:0/3357008177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038806e450 0x7f03880b1020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097c0 tx=0x7f037c01c2a0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- 172.21.15.16:0/3357008177 shutdown_connections 2024-04-26T22:21:54.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 --2- 172.21.15.16:0/3357008177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038806e450 0x7f03880b1020 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- 172.21.15.16:0/3357008177 >> 172.21.15.16:0/3357008177 conn(0x7f03880b6620 msgr2=0x7f03880b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:54.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- 172.21.15.16:0/3357008177 shutdown_connections 2024-04-26T22:21:54.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- 172.21.15.16:0/3357008177 wait complete. 2024-04-26T22:21:54.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 Processor -- start 2024-04-26T22:21:54.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- start start 2024-04-26T22:21:54.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038813ef30 0x7f0388143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f038814dac0 0x7f03881e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f03880b29b0 con 0x7f038806e450 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f03880b2830 con 0x7f038813ef30 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.823+0000 7f0390200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f03880b34f0 con 0x7f038814dac0 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57368/0 (socket says 172.21.15.16:57368) 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 -- 172.21.15.16:0/2514756709 learned_addr learned my addr 172.21.15.16:0/2514756709 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038e200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f038814dac0 0x7f03881e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038ce00640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038813ef30 0x7f0388143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 -- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f038814dac0 msgr2=0x7f03881e1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f038814dac0 0x7f03881e1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 -- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038813ef30 msgr2=0x7f0388143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:54.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038813ef30 0x7f0388143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:54.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 -- 172.21.15.16:0/2514756709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0388143be0 con 0x7f038806e450 2024-04-26T22:21:54.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f038d800640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ae040 tx=0x7f037c01aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0b0050 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c0b1040 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0388143ec0 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c0b7690 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0388145e60 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0388069530 con 0x7f038806e450 2024-04-26T22:21:54.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.827+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f037c0be030 con 0x7f038806e450 2024-04-26T22:21:54.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.831+0000 7f0385600640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 0x7f036806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:54.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.831+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f037c1206b0 con 0x7f038806e450 2024-04-26T22:21:54.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.831+0000 7f038ce00640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 0x7f036806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:54.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.831+0000 7f038ce00640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 0x7f036806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0388144df0 tx=0x7f0374009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:54.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.835+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f037c0c5060 con 0x7f038806e450 2024-04-26T22:21:55.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.999+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03880b82f0 con 0x7f038806e450 2024-04-26T22:21:55.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:54.999+0000 7f0385600640 1 -- 172.21.15.16:0/2514756709 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7f037c015fb0 con 0x7f038806e450 2024-04-26T22:21:55.002 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:55.002 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 msgr2=0x7f036806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 0x7f036806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0388144df0 tx=0x7f0374009040 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 msgr2=0x7f0388145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ae040 tx=0x7f037c01aae0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 shutdown_connections 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0368068380 0x7f036806a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f038814dac0 0x7f03881e1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f038813ef30 0x7f0388143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 --2- 172.21.15.16:0/2514756709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f038806e450 0x7f0388145920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 >> 172.21.15.16:0/2514756709 conn(0x7f03880b6620 msgr2=0x7f03880b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 shutdown_connections 2024-04-26T22:21:55.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.003+0000 7f0390200640 1 -- 172.21.15.16:0/2514756709 wait complete. 2024-04-26T22:21:55.024 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:21:55.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.159+0000 7f4c79e00640 1 Processor -- start 2024-04-26T22:21:55.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.159+0000 7f4c79e00640 1 -- start start 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c79e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4c740a0bb0 0x7f4c740708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c79e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c74152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c79e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740700f0 con 0x7f4c740a07d0 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c79e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4c74070420 con 0x7f4c740a0bb0 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c79e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c74149330 con 0x7f4c741489c0 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4c740a07d0 0x7f4c74073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44402/0 (socket says 172.21.15.16:44402) 2024-04-26T22:21:55.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72a00640 1 -- 172.21.15.16:0/2286612579 learned_addr learned my addr 172.21.15.16:0/2286612579 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> v2:172.21.15.195:3300/0 conn(0x7f4c740a0bb0 0x7f4c740708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c73400640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c74152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063108503 0 0) 0x7f4c740700f0 con 0x7f4c740a07d0 2024-04-26T22:21:55.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c58003530 con 0x7f4c740a07d0 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3723877864 0 0) 0x7f4c58003530 con 0x7f4c740a07d0 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 msgr2=0x7f4c74152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c74152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 >> v2:172.21.15.195:3300/0 conn(0x7f4c740a0bb0 msgr2=0x7f4c740708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 --2- 172.21.15.16:0/2286612579 >> v2:172.21.15.195:3300/0 conn(0x7f4c740a0bb0 0x7f4c740708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74071140 con 0x7f4c740a07d0 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f4c64001680 con 0x7f4c740a07d0 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> v2:172.21.15.195:3300/0 conn(0x7f4c740a0bb0 0x7f4c740708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 >> v1:172.21.15.16:6789/0 conn(0x7f4c740a07d0 legacy=0x7f4c74073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c580039c0 0x7f4c58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c58004810 0x7f4c58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74070420 con 0x7f4c58004810 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74149330 con 0x7f4c580039c0 2024-04-26T22:21:55.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5800ba00 con 0x7f4c741489c0 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c58004810 0x7f4c58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c72a00640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c580039c0 0x7f4c58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c73400640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 -- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 msgr2=0x7f4c580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c741489c0 0x7f4c580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 -- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c580039c0 msgr2=0x7f4c58003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c580039c0 0x7f4c58003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.163+0000 7f4c6a000640 1 -- 172.21.15.16:0/2286612579 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c58003530 con 0x7f4c58004810 2024-04-26T22:21:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c58004810 0x7f4c58004c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009cb0 tx=0x7f4c5c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc19dceedbb5aab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0b2070 con 0x7f4c58004810 2024-04-26T22:21:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c0a5870 con 0x7f4c58004810 2024-04-26T22:21:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c72000640 1 -- 172.21.15.16:0/2286612579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c009880 con 0x7f4c58004810 2024-04-26T22:21:55.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 -- 172.21.15.16:0/2286612579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c58004810 msgr2=0x7f4c58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2286612579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c58004810 0x7f4c58004c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009cb0 tx=0x7f4c5c01cc30 comp rx=0 tx=0).stop 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c73400640 1 -- 172.21.15.16:0/2286612579 reap_dead start 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 -- 172.21.15.16:0/2286612579 shutdown_connections 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 -- 172.21.15.16:0/2286612579 >> 172.21.15.16:0/2286612579 conn(0x7f4c740b87c0 msgr2=0x7f4c740b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 -- 172.21.15.16:0/2286612579 shutdown_connections 2024-04-26T22:21:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 -- 172.21.15.16:0/2286612579 wait complete. 2024-04-26T22:21:55.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.167+0000 7f4c79e00640 1 Processor -- start 2024-04-26T22:21:55.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- start start 2024-04-26T22:21:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58004810 0x7f4c7413d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c7413a3f0 0x7f4c7413a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c741539c0 con 0x7f4c74139170 2024-04-26T22:21:55.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74153840 con 0x7f4c58004810 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4c74153b40 con 0x7f4c7413a3f0 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57386/0 (socket says 172.21.15.16:57386) 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 -- 172.21.15.16:0/2483416748 learned_addr learned my addr 172.21.15.16:0/2483416748 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c72a00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58004810 0x7f4c7413d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c7413a3f0 0x7f4c7413a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 -- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c7413a3f0 msgr2=0x7f4c7413a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c7413a3f0 0x7f4c7413a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 -- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58004810 msgr2=0x7f4c7413d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58004810 0x7f4c7413d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 -- 172.21.15.16:0/2483416748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74139b30 con 0x7f4c74139170 2024-04-26T22:21:55.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c73400640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c011c80 tx=0x7f4c6c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c011e90 con 0x7f4c74139170 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c015430 con 0x7f4c74139170 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c015800 con 0x7f4c74139170 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7413bb70 con 0x7f4c74139170 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c74147f70 con 0x7f4c74139170 2024-04-26T22:21:55.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.171+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c74069530 con 0x7f4c74139170 2024-04-26T22:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.175+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c6c0159a0 con 0x7f4c74139170 2024-04-26T22:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.175+0000 7f4c6be00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 0x7f4c5006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.175+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c6c087660 con 0x7f4c74139170 2024-04-26T22:21:55.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.175+0000 7f4c72a00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 0x7f4c5006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.175+0000 7f4c72a00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 0x7f4c5006a9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001060 tx=0x7f4c64007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.179+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c74139b30 con 0x7f4c74139170 2024-04-26T22:21:55.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c740b7660 con 0x7f4c74139170 2024-04-26T22:21:55.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c6be00640 1 -- 172.21.15.16:0/2483416748 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7f4c6c019030 con 0x7f4c74139170 2024-04-26T22:21:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:55.385 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:55.386 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:55.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 msgr2=0x7f4c5006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 0x7f4c5006a9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c64001060 tx=0x7f4c64007900 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 msgr2=0x7f4c741395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c011c80 tx=0x7f4c6c00f580 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 shutdown_connections 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4c50068520 0x7f4c5006a9e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c74139170 0x7f4c741395f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4c7413a3f0 0x7f4c7413a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 --2- 172.21.15.16:0/2483416748 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c58004810 0x7f4c7413d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 >> 172.21.15.16:0/2483416748 conn(0x7f4c740b87c0 msgr2=0x7f4c7406cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 shutdown_connections 2024-04-26T22:21:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.383+0000 7f4c79e00640 1 -- 172.21.15.16:0/2483416748 wait complete. 2024-04-26T22:21:55.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:21:55.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 Processor -- start 2024-04-26T22:21:55.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 -- start start 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcf6806e450 0x7fcf680b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf6813ef30 0x7fcf6813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6806e830 con 0x7fcf681451f0 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcf680b0d10 con 0x7fcf6813ef30 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf6da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fcf680b0a30 con 0x7fcf6806e450 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf5e000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf6813ef30 0x7fcf6813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf67400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcf681451f0 0x7fcf68145660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44416/0 (socket says 172.21.15.16:44416) 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf67400640 1 -- 172.21.15.16:0/916312026 learned_addr learned my addr 172.21.15.16:0/916312026 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf66a00640 1 --2- 172.21.15.16:0/916312026 >> v2:172.21.15.195:3300/0 conn(0x7fcf6806e450 0x7fcf680b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf5e000640 1 -- 172.21.15.16:0/916312026 >> v2:172.21.15.195:3300/0 conn(0x7fcf6806e450 msgr2=0x7fcf680b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf5e000640 1 --2- 172.21.15.16:0/916312026 >> v2:172.21.15.195:3300/0 conn(0x7fcf6806e450 0x7fcf680b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf5e000640 1 -- 172.21.15.16:0/916312026 >> v1:172.21.15.16:6789/0 conn(0x7fcf681451f0 legacy=0x7fcf68145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.543+0000 7fcf5e000640 1 -- 172.21.15.16:0/916312026 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf680b2cf0 con 0x7fcf6813ef30 2024-04-26T22:21:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf5e000640 1 --2- 172.21.15.16:0/916312026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf6813ef30 0x7fcf6813f390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b7340 tx=0x7fcf5001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1cf35ff0e8d83d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf66000640 1 -- 172.21.15.16:0/916312026 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500b0070 con 0x7fcf6813ef30 2024-04-26T22:21:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf66000640 1 -- 172.21.15.16:0/916312026 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf500ab600 con 0x7fcf6813ef30 2024-04-26T22:21:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf66000640 1 -- 172.21.15.16:0/916312026 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500ab9d0 con 0x7fcf6813ef30 2024-04-26T22:21:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 -- 172.21.15.16:0/916312026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf6813ef30 msgr2=0x7fcf6813f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 --2- 172.21.15.16:0/916312026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf6813ef30 0x7fcf6813f390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b7340 tx=0x7fcf5001c360 comp rx=0 tx=0).stop 2024-04-26T22:21:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 -- 172.21.15.16:0/916312026 shutdown_connections 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 --2- 172.21.15.16:0/916312026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf6813ef30 0x7fcf6813f390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 --2- 172.21.15.16:0/916312026 >> v2:172.21.15.195:3300/0 conn(0x7fcf6806e450 0x7fcf680b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 -- 172.21.15.16:0/916312026 >> 172.21.15.16:0/916312026 conn(0x7fcf680b6620 msgr2=0x7fcf680b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 -- 172.21.15.16:0/916312026 shutdown_connections 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.547+0000 7fcf6da00640 1 -- 172.21.15.16:0/916312026 wait complete. 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 Processor -- start 2024-04-26T22:21:55.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- start start 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6806e450 0x7fcf680afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6813ef30 0x7fcf680714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b6260 con 0x7fcf681451f0 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6813f8d0 con 0x7fcf6806e450 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b63e0 con 0x7fcf6813ef30 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57400/0 (socket says 172.21.15.16:57400) 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 -- 172.21.15.16:0/2946122943 learned_addr learned my addr 172.21.15.16:0/2946122943 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:55.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf66a00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6806e450 0x7fcf680afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf5e000640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6813ef30 0x7fcf680714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 -- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6813ef30 msgr2=0x7fcf680714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6813ef30 0x7fcf680714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 -- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6806e450 msgr2=0x7fcf680afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6806e450 0x7fcf680afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 -- 172.21.15.16:0/2946122943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68150700 con 0x7fcf681451f0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf67400640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ca80 tx=0x7fcf6000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60017070 con 0x7fcf681451f0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6000ac30 con 0x7fcf681451f0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60012600 con 0x7fcf681451f0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf680b01d0 con 0x7fcf681451f0 2024-04-26T22:21:55.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf68071a00 con 0x7fcf681451f0 2024-04-26T22:21:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.551+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf681508d0 con 0x7fcf681451f0 2024-04-26T22:21:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.555+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf6001a070 con 0x7fcf681451f0 2024-04-26T22:21:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.555+0000 7fcf5f400640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.555+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcf600865a0 con 0x7fcf681451f0 2024-04-26T22:21:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.555+0000 7fcf66a00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.555+0000 7fcf66a00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800b9d0 tx=0x7fcf58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.559+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf6000ae20 con 0x7fcf681451f0 2024-04-26T22:21:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf68069530 con 0x7fcf681451f0 2024-04-26T22:21:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf5f400640 1 -- 172.21.15.16:0/2946122943 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3530 (secure 0 0 0) 0x7fcf60056500 con 0x7fcf681451f0 2024-04-26T22:21:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:55.762 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/1833994531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":1833994531},{"type":"v1","addr":"172.21.15.195:6835","nonce":1833994531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:21:21.782581+0000","modified":"2024-04-26T22:21:24.807268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3737019870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3737019870},{"type":"v1","addr":"172.21.15.16:6833","nonce":3737019870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-04-26T22:21:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 msgr2=0x7fcf4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800b9d0 tx=0x7fcf58008040 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 msgr2=0x7fcf68072110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ca80 tx=0x7fcf6000cf40 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 shutdown_connections 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf681451f0 0x7fcf68072110 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6813ef30 0x7fcf680714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 --2- 172.21.15.16:0/2946122943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf6806e450 0x7fcf680afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 >> 172.21.15.16:0/2946122943 conn(0x7fcf680b6620 msgr2=0x7fcf6806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 shutdown_connections 2024-04-26T22:21:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.759+0000 7fcf6da00640 1 -- 172.21.15.16:0/2946122943 wait complete. 2024-04-26T22:21:55.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:21:55.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.919+0000 7fdfe9c00640 1 Processor -- start 2024-04-26T22:21:55.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.919+0000 7fdfe9c00640 1 -- start start 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfe40b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe9c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe406e830 con 0x7fdfe413ef30 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe9c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe40b0a30 con 0x7fdfe414dac0 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe40b0d10 con 0x7fdfe406e450 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfda000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdfe413ef30 0x7fdfe413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44422/0 (socket says 172.21.15.16:44422) 2024-04-26T22:21:55.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfda000640 1 -- 172.21.15.16:0/2009487375 learned_addr learned my addr 172.21.15.16:0/2009487375 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfe40b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164547957 0 0) 0x7fdfe406e830 con 0x7fdfe413ef30 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfc8003530 con 0x7fdfe413ef30 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 232549733 0 0) 0x7fdfc8003530 con 0x7fdfe413ef30 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 msgr2=0x7fdfe40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfe40b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 >> v1:172.21.15.195:6789/0 conn(0x7fdfe414dac0 legacy=0x7fdfe414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe40b2cf0 con 0x7fdfe413ef30 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fdfcc001680 con 0x7fdfe413ef30 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 >> v1:172.21.15.16:6789/0 conn(0x7fdfe413ef30 legacy=0x7fdfe413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc80039f0 0x7fdfc8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8004d50 0x7fdfc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40b0d10 con 0x7fdfc80039f0 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc800bb60 con 0x7fdfc8004d50 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc800bd30 con 0x7fdfe406e450 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc80039f0 0x7fdfc8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfda000640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe3400640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8004d50 0x7fdfc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 -- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 msgr2=0x7fdfc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe406e450 0x7fdfc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 -- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8004d50 msgr2=0x7fdfc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:55.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc8004d50 0x7fdfc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.923+0000 7fdfe2a00640 1 -- 172.21.15.16:0/2009487375 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8003530 con 0x7fdfc80039f0 2024-04-26T22:21:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc80039f0 0x7fdfc8003df0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400e170 tx=0x7fdfd401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd9755b67ea1f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40b2070 con 0x7fdfc80039f0 2024-04-26T22:21:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40a5ae0 con 0x7fdfc80039f0 2024-04-26T22:21:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe2000640 1 -- 172.21.15.16:0/2009487375 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4009c10 con 0x7fdfc80039f0 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 -- 172.21.15.16:0/2009487375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc80039f0 msgr2=0x7fdfc8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/2009487375 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc80039f0 0x7fdfc8003df0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400e170 tx=0x7fdfd401cc60 comp rx=0 tx=0).stop 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe3400640 1 -- 172.21.15.16:0/2009487375 reap_dead start 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 -- 172.21.15.16:0/2009487375 shutdown_connections 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 -- 172.21.15.16:0/2009487375 >> 172.21.15.16:0/2009487375 conn(0x7fdfe40b6620 msgr2=0x7fdfe40b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 -- 172.21.15.16:0/2009487375 shutdown_connections 2024-04-26T22:21:55.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 -- 172.21.15.16:0/2009487375 wait complete. 2024-04-26T22:21:55.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.927+0000 7fdfe9c00640 1 Processor -- start 2024-04-26T22:21:55.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- start start 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc80039f0 0x7fdfe40716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe41496b0 0x7fdfe4150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40b29b0 con 0x7fdfe4072950 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40b2830 con 0x7fdfc80039f0 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe40b1430 con 0x7fdfe41496b0 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57424/0 (socket says 172.21.15.16:57424) 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 -- 172.21.15.16:0/1981087841 learned_addr learned my addr 172.21.15.16:0/1981087841 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc80039f0 0x7fdfe40716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfda000640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe41496b0 0x7fdfe4150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 -- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe41496b0 msgr2=0x7fdfe4150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe41496b0 0x7fdfe4150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 -- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc80039f0 msgr2=0x7fdfe40716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc80039f0 0x7fdfe40716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 -- 172.21.15.16:0/1981087841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe4072f50 con 0x7fdfe4072950 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe3400640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4070450 tx=0x7fdfdc00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc019070 con 0x7fdfe4072950 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0052e0 con 0x7fdfe4072950 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc003860 con 0x7fdfe4072950 2024-04-26T22:21:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe40731c0 con 0x7fdfe4072950 2024-04-26T22:21:55.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4071c30 con 0x7fdfe4072950 2024-04-26T22:21:55.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.931+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe4069530 con 0x7fdfe4072950 2024-04-26T22:21:55.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.935+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdfdc01c070 con 0x7fdfe4072950 2024-04-26T22:21:55.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.935+0000 7fdfdb400640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 0x7fdfc006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:55.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.935+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdfdc085ed0 con 0x7fdfe4072950 2024-04-26T22:21:55.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.935+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 0x7fdfc006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:55.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.935+0000 7fdfe2a00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 0x7fdfc006a810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40af000 tx=0x7fdfd40a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:55.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:55.939+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdfdc055e30 con 0x7fdfe4072950 2024-04-26T22:21:56.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.103+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfe40b7ca0 con 0x7fdfe4072950 2024-04-26T22:21:56.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfdb400640 1 -- 172.21.15.16:0/1981087841 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16593 (secure 0 0 0) 0x7fdfdc05a130 con 0x7fdfe4072950 2024-04-26T22:21:56.108 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:21:56.108 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:21:23.400745+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:21:20.082070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T22:21:20.739294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 msgr2=0x7fdfc006a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 0x7fdfc006a810 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40af000 tx=0x7fdfd40a7040 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 msgr2=0x7fdfe4150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4070450 tx=0x7fdfdc00e820 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 shutdown_connections 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdfc0068350 0x7fdfc006a810 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfe4072950 0x7fdfe4150da0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdfe41496b0 0x7fdfe4150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 --2- 172.21.15.16:0/1981087841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfc80039f0 0x7fdfe40716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 >> 172.21.15.16:0/1981087841 conn(0x7fdfe40b6620 msgr2=0x7fdfe406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 shutdown_connections 2024-04-26T22:21:56.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.107+0000 7fdfe9c00640 1 -- 172.21.15.16:0/1981087841 wait complete. 2024-04-26T22:21:56.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:21:56.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 Processor -- start 2024-04-26T22:21:56.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 -- start start 2024-04-26T22:21:56.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a38070620 0x7f7a38146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 0x7f7a381499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a380718f0 con 0x7f7a38149ef0 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7a381467b0 con 0x7f7a38070620 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a3d800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3814a360 con 0x7f7a380b3710 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a36a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a38070620 0x7f7a38146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a37400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7a38149ef0 0x7f7a3813fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44432/0 (socket says 172.21.15.16:44432) 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a36a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a38070620 0x7f7a38146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57440/0 (socket says 172.21.15.16:57440) 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.271+0000 7f7a37400640 1 -- 172.21.15.16:0/4157791681 learned_addr learned my addr 172.21.15.16:0/4157791681 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36000640 1 --2- 172.21.15.16:0/4157791681 >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 0x7f7a381499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36a00640 1 -- 172.21.15.16:0/4157791681 >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 msgr2=0x7f7a381499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36a00640 1 --2- 172.21.15.16:0/4157791681 >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 0x7f7a381499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36a00640 1 -- 172.21.15.16:0/4157791681 >> v1:172.21.15.16:6789/0 conn(0x7f7a38149ef0 legacy=0x7f7a3813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36a00640 1 -- 172.21.15.16:0/4157791681 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a38070a00 con 0x7f7a38070620 2024-04-26T22:21:56.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36000640 1 --2- 172.21.15.16:0/4157791681 >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 0x7f7a381499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:56.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a36a00640 1 --2- 172.21.15.16:0/4157791681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a38146270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a380b7660 tx=0x7f7a2801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d547a9dd563268 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a35600640 1 -- 172.21.15.16:0/4157791681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280b1070 con 0x7f7a38070620 2024-04-26T22:21:56.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a35600640 1 -- 172.21.15.16:0/4157791681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280ac620 con 0x7f7a38070620 2024-04-26T22:21:56.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a35600640 1 -- 172.21.15.16:0/4157791681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280ac9f0 con 0x7f7a38070620 2024-04-26T22:21:56.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 -- 172.21.15.16:0/4157791681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 msgr2=0x7f7a38146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 --2- 172.21.15.16:0/4157791681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a38146270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7a380b7660 tx=0x7f7a2801c3c0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 -- 172.21.15.16:0/4157791681 shutdown_connections 2024-04-26T22:21:56.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 --2- 172.21.15.16:0/4157791681 >> v2:172.21.15.195:3300/0 conn(0x7f7a380b3710 0x7f7a381499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 --2- 172.21.15.16:0/4157791681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a38146270 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.275+0000 7f7a3d800640 1 -- 172.21.15.16:0/4157791681 >> 172.21.15.16:0/4157791681 conn(0x7f7a380b6620 msgr2=0x7f7a380b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- 172.21.15.16:0/4157791681 shutdown_connections 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- 172.21.15.16:0/4157791681 wait complete. 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 Processor -- start 2024-04-26T22:21:56.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- start start 2024-04-26T22:21:56.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a38149ef0 0x7f7a381dee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a38138200 0x7f7a381df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38153530 con 0x7f7a38070620 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381533b0 con 0x7f7a38138200 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7a381536b0 con 0x7f7a38149ef0 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57450/0 (socket says 172.21.15.16:57450) 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 -- 172.21.15.16:0/1400478590 learned_addr learned my addr 172.21.15.16:0/1400478590 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 -- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a38149ef0 msgr2=0x7f7a381dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a38149ef0 0x7f7a381dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 -- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a38138200 msgr2=0x7f7a381df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a38138200 0x7f7a381df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 -- 172.21.15.16:0/1400478590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a381386e0 con 0x7f7a38070620 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a36a00640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a28018fd0 tx=0x7f7a2801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280b1050 con 0x7f7a38070620 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280bd070 con 0x7f7a38070620 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280b8670 con 0x7f7a38070620 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a381376e0 con 0x7f7a38070620 2024-04-26T22:21:56.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.279+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3813b850 con 0x7f7a38070620 2024-04-26T22:21:56.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a38069450 con 0x7f7a38070620 2024-04-26T22:21:56.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a280b8810 con 0x7f7a38070620 2024-04-26T22:21:56.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a2ea00640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a281211a0 con 0x7f7a38070620 2024-04-26T22:21:56.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a36000640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.283+0000 7f7a36000640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 0x7f7a1806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006e90 tx=0x7f7a24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.287+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a381386e0 con 0x7f7a38070620 2024-04-26T22:21:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.487+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a3806e4f0 con 0x7f7a38070620 2024-04-26T22:21:56.490 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-26T22:21:56.487+0000 7fd560a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:21:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a2ea00640 1 -- 172.21.15.16:0/1400478590 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f7a28016070 con 0x7f7a38070620 2024-04-26T22:21:56.492 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 msgr2=0x7f7a1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 0x7f7a1806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006e90 tx=0x7f7a24008040 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 msgr2=0x7f7a381371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a28018fd0 tx=0x7f7a2801ac00 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 shutdown_connections 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7a18068380 0x7f7a1806a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a38138200 0x7f7a381df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a38149ef0 0x7f7a381dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 --2- 172.21.15.16:0/1400478590 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a38070620 0x7f7a381371a0 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a28018fd0 tx=0x7f7a2801ac00 comp rx=0 tx=0).stop 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 >> 172.21.15.16:0/1400478590 conn(0x7f7a380b6620 msgr2=0x7f7a38072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 shutdown_connections 2024-04-26T22:21:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.491+0000 7f7a3d800640 1 -- 172.21.15.16:0/1400478590 wait complete. 2024-04-26T22:21:56.499 INFO:tasks.ceph.mds.a.smithi016.stderr: -1364> 2024-04-26T22:21:25.352+0000 7f8c4d600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:21:56.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:21:56.550 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T22:21:56.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 Processor -- start 2024-04-26T22:21:56.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 -- start start 2024-04-26T22:21:56.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd938151df0 0x7fd9381541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9380a12d0 con 0x7fd9380b7880 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9380b6ed0 con 0x7fd938073860 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd93da00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd9380b7210 con 0x7fd938151df0 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd92fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd9380b7880 0x7fd938070010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44436/0 (socket says 172.21.15.16:44436) 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd92fe00640 1 -- 172.21.15.16:0/2975147191 learned_addr learned my addr 172.21.15.16:0/2975147191 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd937400640 1 --2- 172.21.15.16:0/2975147191 >> v2:172.21.15.195:3300/0 conn(0x7fd938151df0 0x7fd9381541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540698378 0 0) 0x7fd9380a12d0 con 0x7fd9380b7880 2024-04-26T22:21:56.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd91c003530 con 0x7fd9380b7880 2024-04-26T22:21:56.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069045622 0 0) 0x7fd9380b6ed0 con 0x7fd938073860 2024-04-26T22:21:56.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9380a12d0 con 0x7fd938073860 2024-04-26T22:21:56.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd937400640 1 -- 172.21.15.16:0/2975147191 >> v1:172.21.15.195:6789/0 conn(0x7fd938073860 legacy=0x7fd938142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd937400640 1 -- 172.21.15.16:0/2975147191 >> v1:172.21.15.16:6789/0 conn(0x7fd9380b7880 legacy=0x7fd938070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.663+0000 7fd937400640 1 -- 172.21.15.16:0/2975147191 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd938073c40 con 0x7fd938151df0 2024-04-26T22:21:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd937400640 1 --2- 172.21.15.16:0/2975147191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938151df0 0x7fd9381541e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd930009d90 tx=0x7fd93001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275e8ed9c46f430d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300b2070 con 0x7fd938151df0 2024-04-26T22:21:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9300a5850 con 0x7fd938151df0 2024-04-26T22:21:56.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd936000640 1 -- 172.21.15.16:0/2975147191 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300a5c20 con 0x7fd938151df0 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 -- 172.21.15.16:0/2975147191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938151df0 msgr2=0x7fd9381541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 --2- 172.21.15.16:0/2975147191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938151df0 0x7fd9381541e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd930009d90 tx=0x7fd93001c8e0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 -- 172.21.15.16:0/2975147191 shutdown_connections 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 --2- 172.21.15.16:0/2975147191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938151df0 0x7fd9381541e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 -- 172.21.15.16:0/2975147191 >> 172.21.15.16:0/2975147191 conn(0x7fd9380b8850 msgr2=0x7fd9380b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:56.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 -- 172.21.15.16:0/2975147191 shutdown_connections 2024-04-26T22:21:56.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.667+0000 7fd93da00640 1 -- 172.21.15.16:0/2975147191 wait complete. 2024-04-26T22:21:56.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 Processor -- start 2024-04-26T22:21:56.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- start start 2024-04-26T22:21:56.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938073860 0x7fd9381e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938143880 0x7fd938135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd938142cd0 con 0x7fd938151df0 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd938142b50 con 0x7fd938073860 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd938070720 con 0x7fd938143880 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57462/0 (socket says 172.21.15.16:57462) 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 -- 172.21.15.16:0/691473450 learned_addr learned my addr 172.21.15.16:0/691473450 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd936a00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938073860 0x7fd9381e41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd937400640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938143880 0x7fd938135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 -- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938143880 msgr2=0x7fd938135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938143880 0x7fd938135150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 -- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938073860 msgr2=0x7fd9381e41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:56.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938073860 0x7fd9381e41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 -- 172.21.15.16:0/691473450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd938136d10 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92fe00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c500 tx=0x7fd92000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920017070 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd920005cf0 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd938136ff0 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920007310 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd938153fb0 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.671+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd938069530 con 0x7fd938151df0 2024-04-26T22:21:56.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.675+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd92001a070 con 0x7fd938151df0 2024-04-26T22:21:56.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.675+0000 7fd92ea00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 0x7fd91406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:56.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.675+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7fd920085e90 con 0x7fd938151df0 2024-04-26T22:21:56.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.675+0000 7fd936a00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 0x7fd91406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:56.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.675+0000 7fd936a00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 0x7fd91406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd938151b00 tx=0x7fd928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:56.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.679+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9200563e0 con 0x7fd938151df0 2024-04-26T22:21:56.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:56.879+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd9381479c0 con 0x7fd938151df0 2024-04-26T22:21:57.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.491+0000 7fd92ea00640 1 -- 172.21.15.16:0/691473450 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fd920055ce0 con 0x7fd938151df0 2024-04-26T22:21:57.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 msgr2=0x7fd91406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 0x7fd91406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd938151b00 tx=0x7fd928009040 comp rx=0 tx=0).stop 2024-04-26T22:21:57.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 msgr2=0x7fd938143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c500 tx=0x7fd92000c9c0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 shutdown_connections 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd914068380 0x7fd91406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd938143880 0x7fd938135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd938151df0 0x7fd938143340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 --2- 172.21.15.16:0/691473450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd938073860 0x7fd9381e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 >> 172.21.15.16:0/691473450 conn(0x7fd9380b8850 msgr2=0x7fd938148580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 shutdown_connections 2024-04-26T22:21:57.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.495+0000 7fd93da00640 1 -- 172.21.15.16:0/691473450 wait complete. 2024-04-26T22:21:57.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:21:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 Processor -- start 2024-04-26T22:21:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 -- start start 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1e8c0b6110 0x7f1e8c140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c0b3870 con 0x7f1e8c1498d0 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c070560 con 0x7f1e8c0b3490 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e93a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1e8c070840 con 0x7f1e8c0b6110 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e8be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1e8c0b6110 0x7f1e8c140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e91a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1e8c1498d0 0x7f1e8c150c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44438/0 (socket says 172.21.15.16:44438) 2024-04-26T22:21:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e91a00640 1 -- 172.21.15.16:0/2272957054 learned_addr learned my addr 172.21.15.16:0/2272957054 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e8be00640 1 -- 172.21.15.16:0/2272957054 >> v1:172.21.15.195:6789/0 conn(0x7f1e8c0b3490 legacy=0x7f1e8c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e8be00640 1 -- 172.21.15.16:0/2272957054 >> v1:172.21.15.16:6789/0 conn(0x7f1e8c1498d0 legacy=0x7f1e8c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.711+0000 7f1e8be00640 1 -- 172.21.15.16:0/2272957054 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c0b0bd0 con 0x7f1e8c0b6110 2024-04-26T22:21:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e8be00640 1 --2- 172.21.15.16:0/2272957054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c0b6110 0x7f1e8c140280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18941d78e611217 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e8b400640 1 -- 172.21.15.16:0/2272957054 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e780b0070 con 0x7f1e8c0b6110 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e8b400640 1 -- 172.21.15.16:0/2272957054 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e780ab600 con 0x7f1e8c0b6110 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e8b400640 1 -- 172.21.15.16:0/2272957054 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e780ab9d0 con 0x7f1e8c0b6110 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- 172.21.15.16:0/2272957054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c0b6110 msgr2=0x7f1e8c140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 --2- 172.21.15.16:0/2272957054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c0b6110 0x7f1e8c140280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7801c410 comp rx=0 tx=0).stop 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- 172.21.15.16:0/2272957054 shutdown_connections 2024-04-26T22:21:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 --2- 172.21.15.16:0/2272957054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c0b6110 0x7f1e8c140280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- 172.21.15.16:0/2272957054 >> 172.21.15.16:0/2272957054 conn(0x7f1e8c0b6620 msgr2=0x7f1e8c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- 172.21.15.16:0/2272957054 shutdown_connections 2024-04-26T22:21:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- 172.21.15.16:0/2272957054 wait complete. 2024-04-26T22:21:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 Processor -- start 2024-04-26T22:21:57.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.715+0000 7f1e93a00640 1 -- start start 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 0x7f1e8c0b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e8c0b6110 0x7f1e8c13b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c154db0 con 0x7f1e8c1498d0 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c0b5ad0 con 0x7f1e8c0b3490 2024-04-26T22:21:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8c154f30 con 0x7f1e8c0b6110 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57486/0 (socket says 172.21.15.16:57486) 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 -- 172.21.15.16:0/3317151481 learned_addr learned my addr 172.21.15.16:0/3317151481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e8be00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e8c0b6110 0x7f1e8c13b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91000640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 0x7f1e8c0b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 -- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e8c0b6110 msgr2=0x7f1e8c13b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e8c0b6110 0x7f1e8c13b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 -- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 msgr2=0x7f1e8c0b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 0x7f1e8c0b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 -- 172.21.15.16:0/3317151481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c13c2e0 con 0x7f1e8c1498d0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91000640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 0x7f1e8c0b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e91a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400cb10 tx=0x7f1e8400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84017070 con 0x7f1e8c1498d0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8400ac70 con 0x7f1e8c1498d0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400ae60 con 0x7f1e8c1498d0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8c13a140 con 0x7f1e8c1498d0 2024-04-26T22:21:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8c13a960 con 0x7f1e8c1498d0 2024-04-26T22:21:57.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8c139f70 con 0x7f1e8c1498d0 2024-04-26T22:21:57.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.719+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e8401a070 con 0x7f1e8c1498d0 2024-04-26T22:21:57.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.723+0000 7f1e88c00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 0x7f1e6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:57.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.723+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f1e84086620 con 0x7f1e8c1498d0 2024-04-26T22:21:57.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.723+0000 7f1e91000640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 0x7f1e6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:57.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.723+0000 7f1e91000640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 0x7f1e6c06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001670 tx=0x7f1e80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:57.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.727+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1e84056520 con 0x7f1e8c1498d0 2024-04-26T22:21:57.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:57.891+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1e8c13f070 con 0x7f1e8c1498d0 2024-04-26T22:21:58.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.495+0000 7f1e88c00640 1 -- 172.21.15.16:0/3317151481 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f1e8c13f070 con 0x7f1e8c1498d0 2024-04-26T22:21:58.500 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:21:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 msgr2=0x7f1e6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 0x7f1e6c06a870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001670 tx=0x7f1e80009040 comp rx=0 tx=0).stop 2024-04-26T22:21:58.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 msgr2=0x7f1e8c13bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400cb10 tx=0x7f1e8400a060 comp rx=0 tx=0).stop 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 shutdown_connections 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e6c0683b0 0x7f1e6c06a870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e8c1498d0 0x7f1e8c13bc00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e8c0b6110 0x7f1e8c13b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 --2- 172.21.15.16:0/3317151481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e8c0b3490 0x7f1e8c0b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 >> 172.21.15.16:0/3317151481 conn(0x7f1e8c0b6620 msgr2=0x7f1e8c149ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.499+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 shutdown_connections 2024-04-26T22:21:58.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.503+0000 7f1e93a00640 1 -- 172.21.15.16:0/3317151481 wait complete. 2024-04-26T22:21:58.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:21:58.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 Processor -- start 2024-04-26T22:21:58.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 -- start start 2024-04-26T22:21:58.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 0x7fbd1c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbd1c0b22f0 0x7fbd1c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c0b5c70 con 0x7fbd1c0b3590 2024-04-26T22:21:58.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbd1c0b19d0 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd23000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1c0b1cb0 con 0x7fbd1c0b5890 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd13400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbd1c0b22f0 0x7fbd1c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 0x7fbd1c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd21000640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fbd1c0b3590 0x7fbd1c06ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:56336/0 (socket says 172.21.15.16:56336) 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd21000640 1 -- 172.21.15.16:0/1194528490 learned_addr learned my addr 172.21.15.16:0/1194528490 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd13400640 1 -- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 msgr2=0x7fbd1c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:58.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd13400640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 0x7fbd1c13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd13400640 1 -- 172.21.15.16:0/1194528490 >> v1:172.21.15.195:6789/0 conn(0x7fbd1c0b3590 legacy=0x7fbd1c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd13400640 1 -- 172.21.15.16:0/1194528490 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c0b1f90 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd1b400640 1 -- 172.21.15.16:0/1194528490 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565649459 0 0) 0x7fbd1c0b5c70 con 0x7fbd1c0b3590 2024-04-26T22:21:58.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.671+0000 7fbd1be00640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 0x7fbd1c13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:58.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd13400640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c1489a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097c0 tx=0x7fbd0401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4245bf8bd92f0b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:58.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd1b400640 1 -- 172.21.15.16:0/1194528490 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd040b5070 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd1b400640 1 -- 172.21.15.16:0/1194528490 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd040a8990 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd1b400640 1 -- 172.21.15.16:0/1194528490 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd040a8d60 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 -- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b22f0 msgr2=0x7fbd1c1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c1489a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbd040097c0 tx=0x7fbd0401ec90 comp rx=0 tx=0).stop 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 -- 172.21.15.16:0/1194528490 shutdown_connections 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c1489a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 --2- 172.21.15.16:0/1194528490 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b5890 0x7fbd1c13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 -- 172.21.15.16:0/1194528490 >> 172.21.15.16:0/1194528490 conn(0x7fbd1c0b6620 msgr2=0x7fbd1c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:58.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 -- 172.21.15.16:0/1194528490 shutdown_connections 2024-04-26T22:21:58.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.675+0000 7fbd23000640 1 -- 172.21.15.16:0/1194528490 wait complete. 2024-04-26T22:21:58.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 Processor -- start 2024-04-26T22:21:58.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- start start 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b3590 0x7fbd1c1e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 0x7fbd1c1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c13f830 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c13f6b0 con 0x7fbd1c0b5890 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1c13f9b0 con 0x7fbd1c0b3590 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd13400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b3590 0x7fbd1c1e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57490/0 (socket says 172.21.15.16:57490) 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 -- 172.21.15.16:0/2102648523 learned_addr learned my addr 172.21.15.16:0/2102648523 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd21000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 0x7fbd1c1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 -- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b3590 msgr2=0x7fbd1c1e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b3590 0x7fbd1c1e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 -- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 msgr2=0x7fbd1c1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 0x7fbd1c1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 -- 172.21.15.16:0/2102648523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c1480d0 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd21000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 0x7fbd1c1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd1be00640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e980 tx=0x7fbd0c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c017070 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c00ca00 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c00cdd0 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c140d20 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c140a40 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.679+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c069530 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.683+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd0c01a070 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.683+0000 7fbd18c00640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 0x7fbcf806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:58.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.683+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5357+0+0 (secure 0 0 0) 0x7fbd0c086700 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.683+0000 7fbd13400640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 0x7fbcf806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:58.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.683+0000 7fbd13400640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 0x7fbcf806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd040b2000 tx=0x7fbd040aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:58.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.687+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd0c0567c0 con 0x7fbd1c0b22f0 2024-04-26T22:21:58.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:58.855+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbd1c0b6ce0 con 0x7fbd1c0b22f0 2024-04-26T22:21:59.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.498+0000 7fbd18c00640 1 -- 172.21.15.16:0/2102648523 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7fbd0c05aac0 con 0x7fbd1c0b22f0 2024-04-26T22:21:59.501 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 msgr2=0x7fbcf806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 0x7fbcf806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd040b2000 tx=0x7fbd040aa070 comp rx=0 tx=0).stop 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 msgr2=0x7fbd1c146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e980 tx=0x7fbd0c00ee40 comp rx=0 tx=0).stop 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 shutdown_connections 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fbcf8068380 0x7fbcf806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbd1c0b5890 0x7fbd1c1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbd1c0b3590 0x7fbd1c1e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 --2- 172.21.15.16:0/2102648523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd1c0b22f0 0x7fbd1c146a90 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00e980 tx=0x7fbd0c00ee40 comp rx=0 tx=0).stop 2024-04-26T22:21:59.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 >> 172.21.15.16:0/2102648523 conn(0x7fbd1c0b6620 msgr2=0x7fbd1c1d4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:59.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 shutdown_connections 2024-04-26T22:21:59.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.502+0000 7fbd23000640 1 -- 172.21.15.16:0/2102648523 wait complete. 2024-04-26T22:21:59.533 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:21:59.533 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:21:59.534 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:21:59.534 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:21:59.534 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:21:59.534 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:21:59.534 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:21:59.534 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:21:59.547 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:21:59.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:21:59.548 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:21:59.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:21:59.595 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:21:59.595 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:59.596 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:21:59.596 DEBUG:teuthology.parallel:result is None 2024-04-26T22:21:59.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:21:59.681 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-04-26T22:21:59.683 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T22:21:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 Processor -- start 2024-04-26T22:21:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 -- start start 2024-04-26T22:21:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05cc0b3710 0x7f05cc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 0x7f05cc13fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05cc0718f0 con 0x7f05cc070620 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f05cc14a340 con 0x7f05cc0b3710 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05d1600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f05cc070a00 con 0x7f05cc149ef0 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05cc0b3710 0x7f05cc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05cb400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 0x7f05cc13fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05cc0b3710 0x7f05cc1499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57514/0 (socket says 172.21.15.16:57514) 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 -- 172.21.15.16:0/3761874879 learned_addr learned my addr 172.21.15.16:0/3761874879 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 -- 172.21.15.16:0/3761874879 >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 msgr2=0x7f05cc13fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 --2- 172.21.15.16:0/3761874879 >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 0x7f05cc13fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 -- 172.21.15.16:0/3761874879 >> v1:172.21.15.195:6789/0 conn(0x7f05cc070620 legacy=0x7f05cc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05c3e00640 1 -- 172.21.15.16:0/3761874879 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc146a40 con 0x7f05cc0b3710 2024-04-26T22:21:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.742+0000 7f05cb400640 1 --2- 172.21.15.16:0/3761874879 >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 0x7f05cc13fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05c3e00640 1 --2- 172.21.15.16:0/3761874879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc0b3710 0x7f05cc1499b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b41c0 tx=0x7f05b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dec1920f7471f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05ca000640 1 -- 172.21.15.16:0/3761874879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40ab660 con 0x7f05cc0b3710 2024-04-26T22:21:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05ca000640 1 -- 172.21.15.16:0/3761874879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b40b0070 con 0x7f05cc0b3710 2024-04-26T22:21:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05ca000640 1 -- 172.21.15.16:0/3761874879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40aba20 con 0x7f05cc0b3710 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 -- 172.21.15.16:0/3761874879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc0b3710 msgr2=0x7f05cc1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 --2- 172.21.15.16:0/3761874879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc0b3710 0x7f05cc1499b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0b41c0 tx=0x7f05b401c460 comp rx=0 tx=0).stop 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 -- 172.21.15.16:0/3761874879 shutdown_connections 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 --2- 172.21.15.16:0/3761874879 >> v2:172.21.15.195:3300/0 conn(0x7f05cc149ef0 0x7f05cc13fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 --2- 172.21.15.16:0/3761874879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc0b3710 0x7f05cc1499b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 -- 172.21.15.16:0/3761874879 >> 172.21.15.16:0/3761874879 conn(0x7f05cc0b6620 msgr2=0x7f05cc0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 -- 172.21.15.16:0/3761874879 shutdown_connections 2024-04-26T22:21:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 -- 172.21.15.16:0/3761874879 wait complete. 2024-04-26T22:21:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.746+0000 7f05d1600640 1 Processor -- start 2024-04-26T22:21:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- start start 2024-04-26T22:21:59.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 0x7f05cc144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05cc13af80 0x7f05cc1e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc153530 con 0x7f05cc149ef0 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f05cc1533b0 con 0x7f05cc13af80 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f05cc1536b0 con 0x7f05cc070620 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57526/0 (socket says 172.21.15.16:57526) 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 -- 172.21.15.16:0/1382978208 learned_addr learned my addr 172.21.15.16:0/1382978208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05caa00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 0x7f05cc144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05cb400640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05cc13af80 0x7f05cc1e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 -- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 msgr2=0x7f05cc144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 0x7f05cc144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 -- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05cc13af80 msgr2=0x7f05cc1e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05cc13af80 0x7f05cc1e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 -- 172.21.15.16:0/1382978208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05cc13c8a0 con 0x7f05cc149ef0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05caa00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 0x7f05cc144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c3e00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05b4019070 tx=0x7f05b401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40be5f0 con 0x7f05cc149ef0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b40be790 con 0x7f05cc149ef0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05cc145d90 con 0x7f05cc149ef0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40beb60 con 0x7f05cc149ef0 2024-04-26T22:21:59.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05cc1452d0 con 0x7f05cc149ef0 2024-04-26T22:21:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.750+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05cc069450 con 0x7f05cc149ef0 2024-04-26T22:21:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.754+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05b40c7440 con 0x7f05cc149ef0 2024-04-26T22:21:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.754+0000 7f05c2a00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 0x7f05a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:21:59.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.754+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f05b41212f0 con 0x7f05cc149ef0 2024-04-26T22:21:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.754+0000 7f05caa00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 0x7f05a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:21:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.754+0000 7f05caa00640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 0x7f05a806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05bc001b60 tx=0x7f05bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:21:59.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.758+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f05b4016110 con 0x7f05cc149ef0 2024-04-26T22:21:59.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:21:59.938+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f05cc13f160 con 0x7f05cc149ef0 2024-04-26T22:22:00.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.522+0000 7f05c2a00640 1 -- 172.21.15.16:0/1382978208 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f05b41210d0 con 0x7f05cc149ef0 2024-04-26T22:22:00.527 INFO:teuthology.orchestra.run.smithi016.stderr: removed all blocklist entries 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 msgr2=0x7f05a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 0x7f05a806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05bc001b60 tx=0x7f05bc009040 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 msgr2=0x7f05cc1e1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05b4019070 tx=0x7f05b401aca0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 shutdown_connections 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f05a8068380 0x7f05a806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05cc13af80 0x7f05cc1e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05cc149ef0 0x7f05cc1e1050 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 --2- 172.21.15.16:0/1382978208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f05cc070620 0x7f05cc144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 >> 172.21.15.16:0/1382978208 conn(0x7f05cc0b6620 msgr2=0x7f05cc06e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 shutdown_connections 2024-04-26T22:22:00.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.526+0000 7f05d1600640 1 -- 172.21.15.16:0/1382978208 wait complete. 2024-04-26T22:22:00.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:22:00.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.694+0000 7f1e2ce00640 1 Processor -- start 2024-04-26T22:22:00.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 -- start start 2024-04-26T22:22:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e280b6540 0x7f1e280bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e280bb2b0 con 0x7f1e28148730 2024-04-26T22:22:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1e280bb090 con 0x7f1e280b6540 2024-04-26T22:22:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e2ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e280b7ae0 con 0x7f1e281482b0 2024-04-26T22:22:00.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e280b6540 0x7f1e280bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e1ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1e280b6540 0x7f1e280bab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:53080/0 (socket says 172.21.15.16:53080) 2024-04-26T22:22:00.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e1ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:37146/0 (socket says 172.21.15.16:37146) 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 -- 172.21.15.16:0/1215588419 learned_addr learned my addr 172.21.15.16:0/1215588419 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 -- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 msgr2=0x7f1e28141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 -- 172.21.15.16:0/1215588419 >> v1:172.21.15.195:6789/0 conn(0x7f1e28148730 legacy=0x7f1e2814b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e27400640 1 -- 172.21.15.16:0/1215588419 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e280b5190 con 0x7f1e280b6540 2024-04-26T22:22:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.698+0000 7f1e1ea00640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e27400640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e280b6540 0x7f1e280bab50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ea0911ba4b2a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e26a00640 1 -- 172.21.15.16:0/1215588419 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180b1070 con 0x7f1e280b6540 2024-04-26T22:22:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e26a00640 1 -- 172.21.15.16:0/1215588419 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e180ac640 con 0x7f1e280b6540 2024-04-26T22:22:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e26a00640 1 -- 172.21.15.16:0/1215588419 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180aca10 con 0x7f1e280b6540 2024-04-26T22:22:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e280b6540 msgr2=0x7f1e280bab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e280b6540 0x7f1e280bab50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1801c420 comp rx=0 tx=0).stop 2024-04-26T22:22:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- 172.21.15.16:0/1215588419 shutdown_connections 2024-04-26T22:22:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e281482b0 0x7f1e28141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/1215588419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e280b6540 0x7f1e280bab50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- 172.21.15.16:0/1215588419 >> 172.21.15.16:0/1215588419 conn(0x7f1e28068540 msgr2=0x7f1e28068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- 172.21.15.16:0/1215588419 shutdown_connections 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- 172.21.15.16:0/1215588419 wait complete. 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 Processor -- start 2024-04-26T22:22:00.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.702+0000 7f1e2ce00640 1 -- start start 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e281482b0 0x7f1e281e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e28148730 0x7f1e281e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1e280b5950 con 0x7f1e280b6540 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28142700 con 0x7f1e281482b0 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1e280b5ad0 con 0x7f1e28148730 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57536/0 (socket says 172.21.15.16:57536) 2024-04-26T22:22:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 -- 172.21.15.16:0/369747001 learned_addr learned my addr 172.21.15.16:0/369747001 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e1ea00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e281482b0 0x7f1e281e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27e00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e28148730 0x7f1e281e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 -- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e28148730 msgr2=0x7f1e281e1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e28148730 0x7f1e281e1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 -- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e281482b0 msgr2=0x7f1e281e14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e281482b0 0x7f1e281e14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 -- 172.21.15.16:0/369747001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e281414f0 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e27400640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180bb020 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e180b7700 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e281db5c0 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180b1040 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e280bc190 con 0x7f1e280b6540 2024-04-26T22:22:00.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.706+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e281db3f0 con 0x7f1e280b6540 2024-04-26T22:22:00.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.710+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1e180be020 con 0x7f1e280b6540 2024-04-26T22:22:00.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.710+0000 7f1e1fe00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 0x7f1e0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:00.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.710+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f1e18120ac0 con 0x7f1e280b6540 2024-04-26T22:22:00.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.710+0000 7f1e1ea00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 0x7f1e0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:00.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.710+0000 7f1e1ea00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 0x7f1e0406a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009580 tx=0x7f1e10009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:00.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.714+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1e180c5030 con 0x7f1e280b6540 2024-04-26T22:22:00.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1e281e1120 con 0x7f1e280b6540 2024-04-26T22:22:00.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e1fe00640 1 -- 172.21.15.16:0/369747001 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+5207 (secure 0 0 0) 0x7f1e18016130 con 0x7f1e280b6540 2024-04-26T22:22:00.938 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_dump": [ 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.a", 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgKCxmMaSvNBAATfdR35RbzEMDGhPEw20keg==", 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.b", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgKCxm3RVRORAAzxdHTzRskCgg2cY10Euljw==", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.0", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCiKCxm3AfhEhAAgIRGGpBsOrympcNEnROyWg==", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.940 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.1", 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQClKCxmJ4NjHBAAZc8Cpvvcdms0QpeZj6YWhw==", 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.941 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.2", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCoKCxmXHytJxAAFz7Tz7guiAkAr+aIWWhtNQ==", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.3", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCrKCxm8ZmDMhAAttmYyqVWpq60mMiP5ffXrg==", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.942 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.4", 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCwKCxmrEQUCBAAnTEKBvE532wesEUmHn3VVQ==", 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.5", 2024-04-26T22:22:00.943 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCzKCxmMGaoEhAAiA2+4q3IvYiBdqxVWGp5pg==", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.6", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC2KCxmfgDWGxAAGOQa/3n2Wt8QwbqQwXS24w==", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.7", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC5KCxm/dbDJBAAcGTn35fZ1L/C9lhkux7bsw==", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.0", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQChKCxmIPT0ARAAIv0bynjTbfZef5VoYTU1MQ==", 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.945 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.admin", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgKCxmpvEoGRAApgnSydiX2Dw8WJ/kPBiKGw==", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mds", 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxmgQ5lBRAAUc05QEtYsliRqKDuIoGH1A==", 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxmFxllBRAABuwBn6caBDtSCQM8RRSO7A==", 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-osd", 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxmpiJlBRAAX4aJeAh9LP2J0emSGbeJlA==", 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxm8itlBRAA/IVR2jJCnDVDmksTIsU50A==", 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxm4ThlBRAAXQLEVLXuDFPt+Oqsqzlv6Q==", 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQDJKCxmNUJlBRAA+FO2qp9J4tXJB7CMnNXlvA==", 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.x", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgKCxmsSBeMBAARXtANOMUyLulgCJnX51R1w==", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.y", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgKCxmktnCLBAABKCq4M+4u/ea20vgpj7hvA==", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-04-26T22:22:00.950 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-04-26T22:22:00.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:00.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T22:22:00.951 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 msgr2=0x7f1e0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 0x7f1e0406a840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009580 tx=0x7f1e10009190 comp rx=0 tx=0).stop 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 msgr2=0x7f1e281dace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098a0 tx=0x7f1e1801ac60 comp rx=0 tx=0).stop 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 shutdown_connections 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1e04068380 0x7f1e0406a840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1e28148730 0x7f1e281e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e281482b0 0x7f1e281e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 --2- 172.21.15.16:0/369747001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e280b6540 0x7f1e281dace0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.934+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 >> 172.21.15.16:0/369747001 conn(0x7f1e28068540 msgr2=0x7f1e28149470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.938+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 shutdown_connections 2024-04-26T22:22:00.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:00.938+0000 7f1e2ce00640 1 -- 172.21.15.16:0/369747001 wait complete. 2024-04-26T22:22:00.963 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T22:22:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 Processor -- start 2024-04-26T22:22:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 -- start start 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f144813f050 0x7f144813f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f144813f9d0 con 0x7f14480b5890 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14480b5c70 con 0x7f1448148980 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ea00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f14480b2040 con 0x7f144813f050 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f14480b5890 0x7f14480b3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44442/0 (socket says 172.21.15.16:44442) 2024-04-26T22:22:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 -- 172.21.15.16:0/3106709238 learned_addr learned my addr 172.21.15.16:0/3106709238 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f143f400640 1 --2- 172.21.15.16:0/3106709238 >> v2:172.21.15.195:3300/0 conn(0x7f144813f050 0x7f144813f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555218219 0 0) 0x7f144813f9d0 con 0x7f14480b5890 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f142c003530 con 0x7f14480b5890 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336469692 0 0) 0x7f14480b5c70 con 0x7f1448148980 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f144813f9d0 con 0x7f1448148980 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2663291284 0 0) 0x7f142c003530 con 0x7f14480b5890 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 >> v2:172.21.15.195:3300/0 conn(0x7f144813f050 msgr2=0x7f144813f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 --2- 172.21.15.16:0/3106709238 >> v2:172.21.15.195:3300/0 conn(0x7f144813f050 0x7f144813f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 >> v1:172.21.15.195:6789/0 conn(0x7f1448148980 legacy=0x7f1448148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14480b19f0 con 0x7f14480b5890 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f1438001680 con 0x7f14480b5890 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 >> v1:172.21.15.16:6789/0 conn(0x7f14480b5890 legacy=0x7f14480b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 0x7f142c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c004810 0x7f142c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f142c0051d0 0x7f142c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14480b2040 con 0x7f142c003b50 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f142c00c050 con 0x7f142c004810 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f142c00c250 con 0x7f142c0051d0 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 0x7f142c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f143f400640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c004810 0x7f142c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ca00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f142c0051d0 0x7f142c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 -- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f142c0051d0 msgr2=0x7f142c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f142c0051d0 0x7f142c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 -- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c004810 msgr2=0x7f142c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c004810 0x7f142c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f1447e00640 1 -- 172.21.15.16:0/3106709238 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c003530 con 0x7f142c003b50 2024-04-26T22:22:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ca00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f142c0051d0 0x7f142c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f143f400640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c004810 0x7f142c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.110+0000 7f144ca00640 1 -- 172.21.15.16:0/3106709238 reap_dead start 2024-04-26T22:22:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f1447e00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 0x7f142c003f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f143800c190 tx=0x7f143801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb366d0c778bb856 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438007cd0 con 0x7f142c003b50 2024-04-26T22:22:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14380a9020 con 0x7f142c003b50 2024-04-26T22:22:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f1447400640 1 -- 172.21.15.16:0/3106709238 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438005ae0 con 0x7f142c003b50 2024-04-26T22:22:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 -- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 msgr2=0x7f142c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 0x7f142c003f50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f143800c190 tx=0x7f143801cbf0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 -- 172.21.15.16:0/3106709238 shutdown_connections 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 --2- 172.21.15.16:0/3106709238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f142c003b50 0x7f142c003f50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 -- 172.21.15.16:0/3106709238 >> 172.21.15.16:0/3106709238 conn(0x7f14480b6620 msgr2=0x7f14480b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 -- 172.21.15.16:0/3106709238 shutdown_connections 2024-04-26T22:22:01.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.114+0000 7f144ea00640 1 -- 172.21.15.16:0/3106709238 wait complete. 2024-04-26T22:22:01.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 Processor -- start 2024-04-26T22:22:01.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- start start 2024-04-26T22:22:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c003b50 0x7f144813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1448142060 0x7f14481e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f144806e050 con 0x7f1448143680 2024-04-26T22:22:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f144806ded0 con 0x7f142c003b50 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f144806e1d0 con 0x7f1448142060 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57556/0 (socket says 172.21.15.16:57556) 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 -- 172.21.15.16:0/3126819759 learned_addr learned my addr 172.21.15.16:0/3126819759 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f1447e00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c003b50 0x7f144813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ca00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1448142060 0x7f14481e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 -- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1448142060 msgr2=0x7f14481e2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1448142060 0x7f14481e2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 -- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c003b50 msgr2=0x7f144813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c003b50 0x7f144813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 -- 172.21.15.16:0/3126819759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14481425b0 con 0x7f1448143680 2024-04-26T22:22:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f143f400640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1430009fc0 tx=0x7f1430010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143001a030 con 0x7f1448143680 2024-04-26T22:22:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14300039a0 con 0x7f1448143680 2024-04-26T22:22:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1448142890 con 0x7f1448143680 2024-04-26T22:22:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430003d70 con 0x7f1448143680 2024-04-26T22:22:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1448141780 con 0x7f1448143680 2024-04-26T22:22:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.118+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1448069450 con 0x7f1448143680 2024-04-26T22:22:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.122+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f143001d070 con 0x7f1448143680 2024-04-26T22:22:01.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.122+0000 7f1444c00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.122+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f1430087330 con 0x7f1448143680 2024-04-26T22:22:01.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.122+0000 7f1447e00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.122+0000 7f1447e00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 0x7f142406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14380aa000 tx=0x7f14380019d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.126+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f14300575e0 con 0x7f1448143680 2024-04-26T22:22:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.350+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f14480b9590 con 0x7f1448143680 2024-04-26T22:22:01.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.350+0000 7f1444c00640 1 -- 172.21.15.16:0/3126819759 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f143005b8e0 con 0x7f1448143680 2024-04-26T22:22:01.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 msgr2=0x7f142406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 0x7f142406a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14380aa000 tx=0x7f14380019d0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 msgr2=0x7f1448141240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1430009fc0 tx=0x7f1430010590 comp rx=0 tx=0).stop 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 shutdown_connections 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1424068380 0x7f142406a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1448142060 0x7f14481e2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1448143680 0x7f1448141240 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 --2- 172.21.15.16:0/3126819759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f142c003b50 0x7f144813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 >> 172.21.15.16:0/3126819759 conn(0x7f14480b6620 msgr2=0x7f14480b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 shutdown_connections 2024-04-26T22:22:01.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.354+0000 7f144ea00640 1 -- 172.21.15.16:0/3126819759 wait complete. 2024-04-26T22:22:01.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T22:22:01.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 Processor -- start 2024-04-26T22:22:01.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 -- start start 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0880b3710 0x7ff0881499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff088149ef0 0x7ff08813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880718f0 con 0x7ff088070620 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff08814a3a0 con 0x7ff088149ef0 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.514+0000 7ff08d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff088070a00 con 0x7ff0880b3710 2024-04-26T22:22:01.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff088149ef0 0x7ff08813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff088149ef0 0x7ff08813fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57568/0 (socket says 172.21.15.16:57568) 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 -- 172.21.15.16:0/776980572 learned_addr learned my addr 172.21.15.16:0/776980572 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff07fe00640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0880b3710 0x7ff0881499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 -- 172.21.15.16:0/776980572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0880b3710 msgr2=0x7ff0881499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0880b3710 0x7ff0881499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 -- 172.21.15.16:0/776980572 >> v1:172.21.15.195:6789/0 conn(0x7ff088070620 legacy=0x7ff088146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 -- 172.21.15.16:0/776980572 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088146a40 con 0x7ff088149ef0 2024-04-26T22:22:01.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff087400640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff08813fff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff080009e50 tx=0x7ff08001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733a92f0c8218b1b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff086000640 1 -- 172.21.15.16:0/776980572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800a5830 con 0x7ff088149ef0 2024-04-26T22:22:01.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff086000640 1 -- 172.21.15.16:0/776980572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0800a59d0 con 0x7ff088149ef0 2024-04-26T22:22:01.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.518+0000 7ff086000640 1 -- 172.21.15.16:0/776980572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800a5da0 con 0x7ff088149ef0 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- 172.21.15.16:0/776980572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 msgr2=0x7ff08813fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff08813fff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff080009e50 tx=0x7ff08001c970 comp rx=0 tx=0).stop 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- 172.21.15.16:0/776980572 shutdown_connections 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff08813fff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- 172.21.15.16:0/776980572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff0880b3710 0x7ff0881499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- 172.21.15.16:0/776980572 >> 172.21.15.16:0/776980572 conn(0x7ff0880b6620 msgr2=0x7ff0880b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- 172.21.15.16:0/776980572 shutdown_connections 2024-04-26T22:22:01.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- 172.21.15.16:0/776980572 wait complete. 2024-04-26T22:22:01.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 Processor -- start 2024-04-26T22:22:01.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- start start 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff088070620 0x7ff0881e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0880b2a10 0x7ff0880ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff088153530 con 0x7ff088149ef0 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881533b0 con 0x7ff0880b2a10 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff08d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff0881536b0 con 0x7ff088070620 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff07fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff07fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57574/0 (socket says 172.21.15.16:57574) 2024-04-26T22:22:01.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff07fe00640 1 -- 172.21.15.16:0/877517055 learned_addr learned my addr 172.21.15.16:0/877517055 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:01.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff086a00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff088070620 0x7ff0881e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.522+0000 7ff087400640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0880b2a10 0x7ff0880ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 -- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff088070620 msgr2=0x7ff0881e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff088070620 0x7ff0881e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 -- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0880b2a10 msgr2=0x7ff0880ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0880b2a10 0x7ff0880ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 -- 172.21.15.16:0/877517055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0880b2ea0 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07fe00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e930 tx=0x7ff07000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070017070 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07000ca00 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff088140ff0 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07000cdd0 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881e0ae0 con 0x7ff088149ef0 2024-04-26T22:22:01.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff088069450 con 0x7ff088149ef0 2024-04-26T22:22:01.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff07001a070 con 0x7ff088149ef0 2024-04-26T22:22:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.526+0000 7ff07ea00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 0x7ff06406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.530+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff070086510 con 0x7ff088149ef0 2024-04-26T22:22:01.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.530+0000 7ff086a00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 0x7ff06406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.530+0000 7ff086a00640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 0x7ff06406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff088143c10 tx=0x7ff078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.530+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff070056920 con 0x7ff088149ef0 2024-04-26T22:22:01.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.758+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff0880b06f0 con 0x7ff088149ef0 2024-04-26T22:22:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.758+0000 7ff07ea00640 1 -- 172.21.15.16:0/877517055 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff070086030 con 0x7ff088149ef0 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 msgr2=0x7ff06406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 0x7ff06406a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff088143c10 tx=0x7ff078009040 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 msgr2=0x7ff088148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e930 tx=0x7ff07000edf0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 shutdown_connections 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff064068380 0x7ff06406a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0880b2a10 0x7ff0880ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff088149ef0 0x7ff088148a90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 --2- 172.21.15.16:0/877517055 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff088070620 0x7ff0881e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 >> 172.21.15.16:0/877517055 conn(0x7ff0880b6620 msgr2=0x7ff08806dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 shutdown_connections 2024-04-26T22:22:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.762+0000 7ff08d800640 1 -- 172.21.15.16:0/877517055 wait complete. 2024-04-26T22:22:01.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T22:22:01.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 Processor -- start 2024-04-26T22:22:01.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 -- start start 2024-04-26T22:22:01.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 0x7f3f1c14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1c0b7b70 con 0x7f3f1c0b7790 2024-04-26T22:22:01.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1c14c2f0 con 0x7f3f1c145600 2024-04-26T22:22:01.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f21000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c146160 con 0x7f3f1c148f30 2024-04-26T22:22:01.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f19e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3f1c0b7790 0x7f3f1c148820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44446/0 (socket says 172.21.15.16:44446) 2024-04-26T22:22:01.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f19e00640 1 -- 172.21.15.16:0/1443687636 learned_addr learned my addr 172.21.15.16:0/1443687636 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f11400640 1 --2- 172.21.15.16:0/1443687636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 0x7f3f1c14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.922+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822783259 0 0) 0x7f3f1c0b7b70 con 0x7f3f1c0b7790 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f00003530 con 0x7f3f1c0b7790 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336318838 0 0) 0x7f3f1c14c2f0 con 0x7f3f1c145600 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f11400640 1 -- 172.21.15.16:0/1443687636 >> v1:172.21.15.195:6789/0 conn(0x7f3f1c145600 legacy=0x7f3f1c145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f11400640 1 -- 172.21.15.16:0/1443687636 >> v1:172.21.15.16:6789/0 conn(0x7f3f1c0b7790 legacy=0x7f3f1c148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f11400640 1 -- 172.21.15.16:0/1443687636 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c14c5d0 con 0x7f3f1c148f30 2024-04-26T22:22:01.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f11400640 1 --2- 172.21.15.16:0/1443687636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 0x7f3f1c14bc20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c1462e0 tx=0x7f3f0401c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8948aaf7de80ac0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f040b0070 con 0x7f3f1c148f30 2024-04-26T22:22:01.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f040ab400 con 0x7f3f1c148f30 2024-04-26T22:22:01.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.926+0000 7f3f19400640 1 -- 172.21.15.16:0/1443687636 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c001600 con 0x7f3f1c148f30 2024-04-26T22:22:01.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/1443687636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 msgr2=0x7f3f1c14bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 --2- 172.21.15.16:0/1443687636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 0x7f3f1c14bc20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c1462e0 tx=0x7f3f0401c270 comp rx=0 tx=0).stop 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/1443687636 shutdown_connections 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 --2- 172.21.15.16:0/1443687636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c148f30 0x7f3f1c14bc20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/1443687636 >> 172.21.15.16:0/1443687636 conn(0x7f3f1c06cbc0 msgr2=0x7f3f1c0b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/1443687636 shutdown_connections 2024-04-26T22:22:01.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/1443687636 wait complete. 2024-04-26T22:22:01.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 Processor -- start 2024-04-26T22:22:01.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- start start 2024-04-26T22:22:01.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 0x7f3f1c072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c145600 0x7f3f1c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c156b10 con 0x7f3f1c148f30 2024-04-26T22:22:01.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c156990 con 0x7f3f1c145600 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c156c90 con 0x7f3f1c0b7790 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57588/0 (socket says 172.21.15.16:57588) 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 -- 172.21.15.16:0/971287239 learned_addr learned my addr 172.21.15.16:0/971287239 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f11400640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c145600 0x7f3f1c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f19e00640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 0x7f3f1c072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 -- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 msgr2=0x7f3f1c072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 0x7f3f1c072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 -- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c145600 msgr2=0x7f3f1c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c145600 0x7f3f1c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 -- 172.21.15.16:0/971287239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c1406c0 con 0x7f3f1c148f30 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f19e00640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 0x7f3f1c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f1a800640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c810 tx=0x7f3f1400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14017070 con 0x7f3f1c148f30 2024-04-26T22:22:01.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f14003db0 con 0x7f3f1c148f30 2024-04-26T22:22:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14005290 con 0x7f3f1c148f30 2024-04-26T22:22:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c1409a0 con 0x7f3f1c148f30 2024-04-26T22:22:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.930+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c071b80 con 0x7f3f1c148f30 2024-04-26T22:22:01.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c069450 con 0x7f3f1c148f30 2024-04-26T22:22:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3f1401a070 con 0x7f3f1c148f30 2024-04-26T22:22:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f12a00640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 0x7f3ef806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f3f14085da0 con 0x7f3f1c148f30 2024-04-26T22:22:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f19e00640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 0x7f3ef806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:01.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.934+0000 7f3f19e00640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 0x7f3ef806a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000f70 tx=0x7f3f0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:01.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:01.938+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3f140566a0 con 0x7f3f1c148f30 2024-04-26T22:22:02.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.162+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f3f1c145090 con 0x7f3f1c148f30 2024-04-26T22:22:02.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f12a00640 1 -- 172.21.15.16:0/971287239 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f3f14055fa0 con 0x7f3f1c148f30 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 msgr2=0x7f3ef806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 0x7f3ef806a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000f70 tx=0x7f3f0c009040 comp rx=0 tx=0).stop 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 msgr2=0x7f3f1c1e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c810 tx=0x7f3f1400ccd0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 shutdown_connections 2024-04-26T22:22:02.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ef8068380 0x7f3ef806a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f1c148f30 0x7f3f1c1e3e90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f1c145600 0x7f3f1c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 --2- 172.21.15.16:0/971287239 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3f1c0b7790 0x7f3f1c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 >> 172.21.15.16:0/971287239 conn(0x7f3f1c06cbc0 msgr2=0x7f3f1c145a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 shutdown_connections 2024-04-26T22:22:02.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.166+0000 7f3f21000640 1 -- 172.21.15.16:0/971287239 wait complete. 2024-04-26T22:22:02.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T22:22:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 Processor -- start 2024-04-26T22:22:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 -- start start 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff314148200 0x7ff3141485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff314141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3140b3cf0 con 0x7ff3140b37a0 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff3140b3fd0 con 0x7ff314148200 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff318c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff3140b1f90 con 0x7ff3140b2c60 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff312800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff3140b37a0 0x7ff314142200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44460/0 (socket says 172.21.15.16:44460) 2024-04-26T22:22:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff312800640 1 -- 172.21.15.16:0/1063756100 learned_addr learned my addr 172.21.15.16:0/1063756100 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff314141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311e00640 1 --2- 172.21.15.16:0/1063756100 >> v2:172.21.15.195:3300/0 conn(0x7ff314148200 0x7ff3141485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173376357 0 0) 0x7ff3140b3cf0 con 0x7ff3140b37a0 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f8003530 con 0x7ff3140b37a0 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2713053804 0 0) 0x7ff2f8003530 con 0x7ff3140b37a0 2024-04-26T22:22:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 msgr2=0x7ff314141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff314141cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 >> v2:172.21.15.195:3300/0 conn(0x7ff314148200 msgr2=0x7ff3141485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 --2- 172.21.15.16:0/1063756100 >> v2:172.21.15.195:3300/0 conn(0x7ff314148200 0x7ff3141485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3140b2270 con 0x7ff3140b37a0 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7ff30c001a00 con 0x7ff3140b37a0 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 >> v1:172.21.15.16:6789/0 conn(0x7ff3140b37a0 legacy=0x7ff314142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff2f80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff2f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f8004d50 0x7ff2f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3140b3fd0 con 0x7ff2f8003f40 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff3140b1f90 con 0x7ff2f8004d50 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f800bab0 con 0x7ff3140b2c60 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff2f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311e00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff2f80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff312800640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f8004d50 0x7ff2f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 -- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 msgr2=0x7ff2f80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff3140b2c60 0x7ff2f80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 -- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f8004d50 msgr2=0x7ff2f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2f8004d50 0x7ff2f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.330+0000 7ff311400640 1 -- 172.21.15.16:0/1063756100 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f8003530 con 0x7ff2f8003f40 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff311400640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff2f8004810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff300009ab0 tx=0x7ff30001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13df1427e5cca199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000b2070 con 0x7ff2f8003f40 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3000a55c0 con 0x7ff2f8003f40 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff310a00640 1 -- 172.21.15.16:0/1063756100 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000096b0 con 0x7ff2f8003f40 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 -- 172.21.15.16:0/1063756100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 msgr2=0x7ff2f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 --2- 172.21.15.16:0/1063756100 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff2f8004810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff300009ab0 tx=0x7ff30001ca50 comp rx=0 tx=0).stop 2024-04-26T22:22:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff312800640 1 -- 172.21.15.16:0/1063756100 reap_dead start 2024-04-26T22:22:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 -- 172.21.15.16:0/1063756100 shutdown_connections 2024-04-26T22:22:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 -- 172.21.15.16:0/1063756100 >> 172.21.15.16:0/1063756100 conn(0x7ff3140b6620 msgr2=0x7ff3140b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 -- 172.21.15.16:0/1063756100 shutdown_connections 2024-04-26T22:22:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.334+0000 7ff318c00640 1 -- 172.21.15.16:0/1063756100 wait complete. 2024-04-26T22:22:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 Processor -- start 2024-04-26T22:22:02.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- start start 2024-04-26T22:22:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff31414a440 0x7ff31413ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff314144cf0 0x7ff314145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff31414f660 con 0x7ff2f8003f40 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff31414f4e0 con 0x7ff314144cf0 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff31414f7e0 con 0x7ff31414a440 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57610/0 (socket says 172.21.15.16:57610) 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 -- 172.21.15.16:0/1979607694 learned_addr learned my addr 172.21.15.16:0/1979607694 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311400640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff31414a440 0x7ff31413ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff312800640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff314144cf0 0x7ff314145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 -- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff31414a440 msgr2=0x7ff31413ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff31414a440 0x7ff31413ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 -- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff314144cf0 msgr2=0x7ff314145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff314144cf0 0x7ff314145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 -- 172.21.15.16:0/1979607694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31414aae0 con 0x7ff2f8003f40 2024-04-26T22:22:02.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff311e00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff304011b00 tx=0x7ff304011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30400fb50 con 0x7ff2f8003f40 2024-04-26T22:22:02.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30400fcf0 con 0x7ff2f8003f40 2024-04-26T22:22:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30400fea0 con 0x7ff2f8003f40 2024-04-26T22:22:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3141e2540 con 0x7ff2f8003f40 2024-04-26T22:22:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3141e2f10 con 0x7ff2f8003f40 2024-04-26T22:22:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.338+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff314149d50 con 0x7ff2f8003f40 2024-04-26T22:22:02.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.342+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff304012040 con 0x7ff2f8003f40 2024-04-26T22:22:02.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.342+0000 7ff30a000640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 0x7ff2f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.342+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff304086b80 con 0x7ff2f8003f40 2024-04-26T22:22:02.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.342+0000 7ff311400640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 0x7ff2f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.342+0000 7ff311400640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 0x7ff2f406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3000af000 tx=0x7ff3000046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.346+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff31414aae0 con 0x7ff2f8003f40 2024-04-26T22:22:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.570+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff3141e2330 con 0x7ff2f8003f40 2024-04-26T22:22:02.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff30a000640 1 -- 172.21.15.16:0/1979607694 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ff304019030 con 0x7ff2f8003f40 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 msgr2=0x7ff2f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 0x7ff2f406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff3000af000 tx=0x7ff3000046d0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 msgr2=0x7ff3141497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff304011b00 tx=0x7ff304011f00 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 shutdown_connections 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff2f4068380 0x7ff2f406a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff314144cf0 0x7ff314145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff31414a440 0x7ff31413ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 --2- 172.21.15.16:0/1979607694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2f8003f40 0x7ff3141497d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 >> 172.21.15.16:0/1979607694 conn(0x7ff3140b6620 msgr2=0x7ff3141502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:02.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 shutdown_connections 2024-04-26T22:22:02.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.574+0000 7ff318c00640 1 -- 172.21.15.16:0/1979607694 wait complete. 2024-04-26T22:22:02.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T22:22:02.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 Processor -- start 2024-04-26T22:22:02.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 -- start start 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb718073890 0x7fb7180b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb718073c70 con 0x7fb7180b6dc0 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb718142d60 con 0x7fb71814bf60 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb71ec00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb7180b7250 con 0x7fb718073890 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb7180b6dc0 0x7fb718142650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44470/0 (socket says 172.21.15.16:44470) 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717400640 1 -- 172.21.15.16:0/17310548 learned_addr learned my addr 172.21.15.16:0/17310548 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:02.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717e00640 1 --2- 172.21.15.16:0/17310548 >> v2:172.21.15.195:3300/0 conn(0x7fb718073890 0x7fb7180b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb716a00640 1 -- 172.21.15.16:0/17310548 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977948324 0 0) 0x7fb718073c70 con 0x7fb7180b6dc0 2024-04-26T22:22:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb716a00640 1 -- 172.21.15.16:0/17310548 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6fc003530 con 0x7fb7180b6dc0 2024-04-26T22:22:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717e00640 1 -- 172.21.15.16:0/17310548 >> v1:172.21.15.195:6789/0 conn(0x7fb71814bf60 legacy=0x7fb718152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717e00640 1 -- 172.21.15.16:0/17310548 >> v1:172.21.15.16:6789/0 conn(0x7fb7180b6dc0 legacy=0x7fb718142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.738+0000 7fb717e00640 1 -- 172.21.15.16:0/17310548 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7180b7530 con 0x7fb718073890 2024-04-26T22:22:02.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb717e00640 1 --2- 172.21.15.16:0/17310548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb718073890 0x7fb7180b7960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097c0 tx=0x7fb70801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6800daba80674a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb716a00640 1 -- 172.21.15.16:0/17310548 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7080ab430 con 0x7fb718073890 2024-04-26T22:22:02.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb716a00640 1 -- 172.21.15.16:0/17310548 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7080b0070 con 0x7fb718073890 2024-04-26T22:22:02.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb716a00640 1 -- 172.21.15.16:0/17310548 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7080ab7f0 con 0x7fb718073890 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 -- 172.21.15.16:0/17310548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb718073890 msgr2=0x7fb7180b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 --2- 172.21.15.16:0/17310548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb718073890 0x7fb7180b7960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097c0 tx=0x7fb70801c410 comp rx=0 tx=0).stop 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 -- 172.21.15.16:0/17310548 shutdown_connections 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 --2- 172.21.15.16:0/17310548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb718073890 0x7fb7180b7960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 -- 172.21.15.16:0/17310548 >> 172.21.15.16:0/17310548 conn(0x7fb7180b8850 msgr2=0x7fb7180b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 -- 172.21.15.16:0/17310548 shutdown_connections 2024-04-26T22:22:02.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 -- 172.21.15.16:0/17310548 wait complete. 2024-04-26T22:22:02.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.742+0000 7fb71ec00640 1 Processor -- start 2024-04-26T22:22:02.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- start start 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb718073890 0x7fb718148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 0x7fb7181e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb718157180 con 0x7fb71814bf60 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb718157000 con 0x7fb7180b5cc0 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb718157300 con 0x7fb718073890 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57620/0 (socket says 172.21.15.16:57620) 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 -- 172.21.15.16:0/3003180056 learned_addr learned my addr 172.21.15.16:0/3003180056 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71cc00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 0x7fb7181e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717e00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb718073890 0x7fb718148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 -- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb718073890 msgr2=0x7fb718148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb718073890 0x7fb718148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 -- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 msgr2=0x7fb7181e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 0x7fb7181e43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 -- 172.21.15.16:0/3003180056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb718149310 con 0x7fb71814bf60 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71cc00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 0x7fb7181e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:02.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb717400640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c450 tx=0x7fb70400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704017070 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb704005cf0 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704007290 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb718146480 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb718147180 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.746+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb718143120 con 0x7fb71814bf60 2024-04-26T22:22:02.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.750+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb70401a070 con 0x7fb71814bf60 2024-04-26T22:22:02.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.750+0000 7fb70fe00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 0x7fb6f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:02.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.750+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fb704085a50 con 0x7fb71814bf60 2024-04-26T22:22:02.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.750+0000 7fb717e00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 0x7fb6f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:02.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.750+0000 7fb717e00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 0x7fb6f806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7080af000 tx=0x7fb7080a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:02.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.754+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb704056350 con 0x7fb71814bf60 2024-04-26T22:22:02.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.986+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fb71806ed10 con 0x7fb71814bf60 2024-04-26T22:22:02.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.986+0000 7fb70fe00640 1 -- 172.21.15.16:0/3003180056 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fb704055c50 con 0x7fb71814bf60 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 msgr2=0x7fb6f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 0x7fb6f806a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7080af000 tx=0x7fb7080a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 msgr2=0x7fb7180b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb70400c450 tx=0x7fb70400c910 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 shutdown_connections 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb6f8068380 0x7fb6f806a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7180b5cc0 0x7fb7181e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb71814bf60 0x7fb7180b41a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 --2- 172.21.15.16:0/3003180056 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb718073890 0x7fb718148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 >> 172.21.15.16:0/3003180056 conn(0x7fb7180b8850 msgr2=0x7fb718142420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 shutdown_connections 2024-04-26T22:22:02.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:02.990+0000 7fb71ec00640 1 -- 172.21.15.16:0/3003180056 wait complete. 2024-04-26T22:22:03.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T22:22:03.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 Processor -- start 2024-04-26T22:22:03.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 -- start start 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 0x7fcf68153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf68148440 con 0x7fcf680ae890 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6806e510 con 0x7fcf6806e130 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.150+0000 7fcf6e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b4520 con 0x7fcf68142820 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf5fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcf680ae890 0x7fcf68142110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44484/0 (socket says 172.21.15.16:44484) 2024-04-26T22:22:03.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf5fe00640 1 -- 172.21.15.16:0/2357140478 learned_addr learned my addr 172.21.15.16:0/2357140478 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:03.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf67e00640 1 --2- 172.21.15.16:0/2357140478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 0x7fcf68153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706908726 0 0) 0x7fcf50001120 con 0x7fcf680ae890 2024-04-26T22:22:03.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf4c003530 con 0x7fcf680ae890 2024-04-26T22:22:03.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359277090 0 0) 0x7fcf6806e510 con 0x7fcf6806e130 2024-04-26T22:22:03.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf67e00640 1 -- 172.21.15.16:0/2357140478 >> v1:172.21.15.195:6789/0 conn(0x7fcf6806e130 legacy=0x7fcf68148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf67e00640 1 -- 172.21.15.16:0/2357140478 >> v1:172.21.15.16:6789/0 conn(0x7fcf680ae890 legacy=0x7fcf68142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf67e00640 1 -- 172.21.15.16:0/2357140478 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68073620 con 0x7fcf68142820 2024-04-26T22:22:03.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.154+0000 7fcf67e00640 1 --2- 172.21.15.16:0/2357140478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 0x7fcf68153db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009dc0 tx=0x7fcf6001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d24b422b509703 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b2070 con 0x7fcf68142820 2024-04-26T22:22:03.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600a5730 con 0x7fcf68142820 2024-04-26T22:22:03.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf66a00640 1 -- 172.21.15.16:0/2357140478 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600a5ae0 con 0x7fcf68142820 2024-04-26T22:22:03.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- 172.21.15.16:0/2357140478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 msgr2=0x7fcf68153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 --2- 172.21.15.16:0/2357140478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 0x7fcf68153db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009dc0 tx=0x7fcf6001c870 comp rx=0 tx=0).stop 2024-04-26T22:22:03.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- 172.21.15.16:0/2357140478 shutdown_connections 2024-04-26T22:22:03.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 --2- 172.21.15.16:0/2357140478 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf68142820 0x7fcf68153db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- 172.21.15.16:0/2357140478 >> 172.21.15.16:0/2357140478 conn(0x7fcf680b6620 msgr2=0x7fcf680b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- 172.21.15.16:0/2357140478 shutdown_connections 2024-04-26T22:22:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- 172.21.15.16:0/2357140478 wait complete. 2024-04-26T22:22:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 Processor -- start 2024-04-26T22:22:03.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- start start 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 0x7fcf68070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf680ae890 0x7fcf6814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68156c90 con 0x7fcf68142820 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68156b10 con 0x7fcf680ae890 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf6e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcf68156e10 con 0x7fcf6806e130 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57622/0 (socket says 172.21.15.16:57622) 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 -- 172.21.15.16:0/3205153182 learned_addr learned my addr 172.21.15.16:0/3205153182 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf5fe00640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf680ae890 0x7fcf6814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67400640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 0x7fcf68070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 -- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 msgr2=0x7fcf68070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 0x7fcf68070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 -- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf680ae890 msgr2=0x7fcf6814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf680ae890 0x7fcf6814aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67e00640 1 -- 172.21.15.16:0/3205153182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68071350 con 0x7fcf68142820 2024-04-26T22:22:03.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.158+0000 7fcf67400640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 0x7fcf68070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf67e00640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf6001a4a0 tx=0x7fcf60019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600bd020 con 0x7fcf68142820 2024-04-26T22:22:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600b8470 con 0x7fcf68142820 2024-04-26T22:22:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf68142ff0 con 0x7fcf68142820 2024-04-26T22:22:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b2040 con 0x7fcf68142820 2024-04-26T22:22:03.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf68072b70 con 0x7fcf68142820 2024-04-26T22:22:03.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68069450 con 0x7fcf68142820 2024-04-26T22:22:03.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf600c0020 con 0x7fcf68142820 2024-04-26T22:22:03.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.162+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fcf60121270 con 0x7fcf68142820 2024-04-26T22:22:03.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.166+0000 7fcf67400640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.166+0000 7fcf67400640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f70 tx=0x7fcf58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.166+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf600c7070 con 0x7fcf68142820 2024-04-26T22:22:03.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.394+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fcf6806cb30 con 0x7fcf68142820 2024-04-26T22:22:03.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf5f400640 1 -- 172.21.15.16:0/3205153182 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fcf60016580 con 0x7fcf68142820 2024-04-26T22:22:03.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 msgr2=0x7fcf4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f70 tx=0x7fcf58009040 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 msgr2=0x7fcf6814b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf6001a4a0 tx=0x7fcf60019610 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 shutdown_connections 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcf44068380 0x7fcf4406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf68142820 0x7fcf6814b420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf680ae890 0x7fcf6814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 --2- 172.21.15.16:0/3205153182 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf6806e130 0x7fcf68070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 >> 172.21.15.16:0/3205153182 conn(0x7fcf680b6620 msgr2=0x7fcf68141540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 shutdown_connections 2024-04-26T22:22:03.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.398+0000 7fcf6e600640 1 -- 172.21.15.16:0/3205153182 wait complete. 2024-04-26T22:22:03.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:03.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.558+0000 7fc45de00640 1 Processor -- start 2024-04-26T22:22:03.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.558+0000 7fc45de00640 1 -- start start 2024-04-26T22:22:03.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc45de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc45813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc45de00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45806e830 con 0x7fc45814dac0 2024-04-26T22:22:03.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc45de00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4580b0a30 con 0x7fc45806e450 2024-04-26T22:22:03.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc45de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc4580b0d10 con 0x7fc45813ef30 2024-04-26T22:22:03.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc45814dac0 0x7fc45814feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44492/0 (socket says 172.21.15.16:44492) 2024-04-26T22:22:03.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 -- 172.21.15.16:0/3338674216 learned_addr learned my addr 172.21.15.16:0/3338674216 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:03.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc44e000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc45813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569664560 0 0) 0x7fc45806e830 con 0x7fc45814dac0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc43c003530 con 0x7fc45814dac0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2886818574 0 0) 0x7fc43c003530 con 0x7fc45814dac0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 msgr2=0x7fc45813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc45813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 >> v1:172.21.15.195:6789/0 conn(0x7fc45806e450 legacy=0x7fc4580b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4580b2cf0 con 0x7fc45814dac0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fc450001680 con 0x7fc45814dac0 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 >> v1:172.21.15.16:6789/0 conn(0x7fc45814dac0 legacy=0x7fc45814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc43c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc43c003f30 0x7fc43c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc43c004d50 0x7fc43c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580b0d10 con 0x7fc43c004d50 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c00bb90 con 0x7fc43c003f30 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc43c00dfa0 con 0x7fc45813ef30 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc43c004d50 0x7fc43c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456a00640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc43c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc44e000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc43c003f30 0x7fc43c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 -- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 msgr2=0x7fc43c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc43c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 -- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc43c003f30 msgr2=0x7fc43c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc43c003f30 0x7fc43c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc457400640 1 -- 172.21.15.16:0/3338674216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c003530 con 0x7fc43c004d50 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc456a00640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45813ef30 0x7fc43c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:03.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.562+0000 7fc44e000640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc43c003f30 0x7fc43c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:03.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc457400640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc43c004d50 0x7fc43c0051d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc4500050c0 tx=0x7fc45001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21ac2f8ad854fce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450004c90 con 0x7fc43c004d50 2024-04-26T22:22:03.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc450005ba0 con 0x7fc43c004d50 2024-04-26T22:22:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc456000640 1 -- 172.21.15.16:0/3338674216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450008110 con 0x7fc43c004d50 2024-04-26T22:22:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 -- 172.21.15.16:0/3338674216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc43c004d50 msgr2=0x7fc43c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 --2- 172.21.15.16:0/3338674216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc43c004d50 0x7fc43c0051d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc4500050c0 tx=0x7fc45001d2c0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc457400640 1 -- 172.21.15.16:0/3338674216 reap_dead start 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 -- 172.21.15.16:0/3338674216 shutdown_connections 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 -- 172.21.15.16:0/3338674216 >> 172.21.15.16:0/3338674216 conn(0x7fc4580b6620 msgr2=0x7fc4580b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 -- 172.21.15.16:0/3338674216 shutdown_connections 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.566+0000 7fc45de00640 1 -- 172.21.15.16:0/3338674216 wait complete. 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 Processor -- start 2024-04-26T22:22:03.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- start start 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc43c004d50 0x7fc4581429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 0x7fc4581e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580b3670 con 0x7fc45813fb60 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580b34f0 con 0x7fc4581e0990 2024-04-26T22:22:03.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc4580b4520 con 0x7fc43c004d50 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57644/0 (socket says 172.21.15.16:57644) 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 -- 172.21.15.16:0/897892976 learned_addr learned my addr 172.21.15.16:0/897892976 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc456a00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc43c004d50 0x7fc4581429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc44e000640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 0x7fc4581e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 -- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc43c004d50 msgr2=0x7fc4581429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc43c004d50 0x7fc4581429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 -- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 msgr2=0x7fc4581e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 0x7fc4581e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 -- 172.21.15.16:0/897892976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc458142260 con 0x7fc45813fb60 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc44e000640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 0x7fc4581e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:03.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc457400640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc45001d0f0 tx=0x7fc43c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450004c90 con 0x7fc45813fb60 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4500059a0 con 0x7fc45813fb60 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450001be0 con 0x7fc45813fb60 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc458140ca0 con 0x7fc45813fb60 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc458141f80 con 0x7fc45813fb60 2024-04-26T22:22:03.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.570+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc458069530 con 0x7fc45813fb60 2024-04-26T22:22:03.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.574+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4500b7030 con 0x7fc45813fb60 2024-04-26T22:22:03.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.574+0000 7fc44fe00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 0x7fc43406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.574+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fc45011fa60 con 0x7fc45813fb60 2024-04-26T22:22:03.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.574+0000 7fc456a00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 0x7fc43406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.574+0000 7fc456a00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 0x7fc43406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc4480054b0 tx=0x7fc448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.578+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc458142260 con 0x7fc45813fb60 2024-04-26T22:22:03.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc458072d50 con 0x7fc45813fb60 2024-04-26T22:22:03.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc44fe00640 1 -- 172.21.15.16:0/897892976 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+12879 (secure 0 0 0) 0x7fc450016fd0 con 0x7fc45813fb60 2024-04-26T22:22:03.750 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:03.750 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":27,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:00.524950+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 msgr2=0x7fc43406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 0x7fc43406a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc4480054b0 tx=0x7fc448009040 comp rx=0 tx=0).stop 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 msgr2=0x7fc45813ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc45001d0f0 tx=0x7fc43c005840 comp rx=0 tx=0).stop 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 shutdown_connections 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc434068380 0x7fc43406a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc45813fb60 0x7fc45813ffe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4581e0990 0x7fc4581e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 --2- 172.21.15.16:0/897892976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc43c004d50 0x7fc4581429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 >> 172.21.15.16:0/897892976 conn(0x7fc4580b6620 msgr2=0x7fc4580b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:03.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 shutdown_connections 2024-04-26T22:22:03.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.746+0000 7fc45de00640 1 -- 172.21.15.16:0/897892976 wait complete. 2024-04-26T22:22:03.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:22:03.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:22:03.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.910+0000 7f3d7d600640 1 Processor -- start 2024-04-26T22:22:03.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.910+0000 7f3d7d600640 1 -- start start 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d7d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 0x7f3d78154540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d7d600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d78075e50 con 0x7f3d78075a70 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d7d600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7809ce70 con 0x7f3d78147c10 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d7d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7809c9e0 con 0x7f3d78148070 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3d78075a70 0x7f3d7809ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44502/0 (socket says 172.21.15.16:44502) 2024-04-26T22:22:03.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76a00640 1 -- 172.21.15.16:0/171752984 learned_addr learned my addr 172.21.15.16:0/171752984 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d77400640 1 --2- 172.21.15.16:0/171752984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 0x7f3d78154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216727347 0 0) 0x7f3d78075e50 con 0x7f3d78075a70 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5c003530 con 0x7f3d78075a70 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723272215 0 0) 0x7f3d7809ce70 con 0x7f3d78147c10 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d78075e50 con 0x7f3d78147c10 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d77400640 1 -- 172.21.15.16:0/171752984 >> v1:172.21.15.195:6789/0 conn(0x7f3d78147c10 legacy=0x7f3d78150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d77400640 1 -- 172.21.15.16:0/171752984 >> v1:172.21.15.16:6789/0 conn(0x7f3d78075a70 legacy=0x7f3d7809ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2264130999 0 0) 0x7f3d5c003530 con 0x7f3d78075a70 2024-04-26T22:22:03.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.914+0000 7f3d77400640 1 -- 172.21.15.16:0/171752984 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d780b5f90 con 0x7f3d78148070 2024-04-26T22:22:03.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d77400640 1 --2- 172.21.15.16:0/171752984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 0x7f3d78154540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009dc0 tx=0x7f3d7001c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788e1991902a9c76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68001680 con 0x7f3d78148070 2024-04-26T22:22:03.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d700a8440 con 0x7f3d78148070 2024-04-26T22:22:03.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d76000640 1 -- 172.21.15.16:0/171752984 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700a87f0 con 0x7f3d78148070 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- 172.21.15.16:0/171752984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 msgr2=0x7f3d78154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 --2- 172.21.15.16:0/171752984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 0x7f3d78154540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009dc0 tx=0x7f3d7001c790 comp rx=0 tx=0).stop 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- 172.21.15.16:0/171752984 shutdown_connections 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 --2- 172.21.15.16:0/171752984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78148070 0x7f3d78154540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- 172.21.15.16:0/171752984 >> 172.21.15.16:0/171752984 conn(0x7f3d7809fab0 msgr2=0x7f3d780ba2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- 172.21.15.16:0/171752984 shutdown_connections 2024-04-26T22:22:03.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- 172.21.15.16:0/171752984 wait complete. 2024-04-26T22:22:03.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 Processor -- start 2024-04-26T22:22:03.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- start start 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78075a70 0x7f3d781e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 0x7f3d7809e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780bb0f0 con 0x7f3d78148070 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780b5c10 con 0x7f3d78147c10 2024-04-26T22:22:03.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.918+0000 7f3d7d600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d780b5880 con 0x7f3d78075a70 2024-04-26T22:22:03.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57654/0 (socket says 172.21.15.16:57654) 2024-04-26T22:22:03.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 -- 172.21.15.16:0/4274371208 learned_addr learned my addr 172.21.15.16:0/4274371208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d76a00640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78075a70 0x7f3d781e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6e000640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 0x7f3d7809e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 -- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78075a70 msgr2=0x7f3d781e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78075a70 0x7f3d781e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 -- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 msgr2=0x7f3d7809e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 0x7f3d7809e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 -- 172.21.15.16:0/4274371208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d780b6790 con 0x7f3d78148070 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6e000640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 0x7f3d7809e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d77400640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3d7001a3c0 tx=0x7f3d70019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700c0070 con 0x7f3d78148070 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70004250 con 0x7f3d78148070 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70009450 con 0x7f3d78148070 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7809d220 con 0x7f3d78148070 2024-04-26T22:22:03.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7813d990 con 0x7f3d78148070 2024-04-26T22:22:03.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7809d3f0 con 0x7f3d78148070 2024-04-26T22:22:03.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d70004600 con 0x7f3d78148070 2024-04-26T22:22:03.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.922+0000 7f3d6f400640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 0x7f3d5406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:03.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.926+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f3d701209c0 con 0x7f3d78148070 2024-04-26T22:22:03.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.926+0000 7f3d76a00640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 0x7f3d5406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:03.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.926+0000 7f3d76a00640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 0x7f3d5406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d68001000 tx=0x7f3d68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:03.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:03.926+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3d700ac030 con 0x7f3d78148070 2024-04-26T22:22:04.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d78069530 con 0x7f3d78148070 2024-04-26T22:22:04.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d6f400640 1 -- 172.21.15.16:0/4274371208 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3d700164a0 con 0x7f3d78148070 2024-04-26T22:22:04.098 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 msgr2=0x7f3d5406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 0x7f3d5406a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d68001000 tx=0x7f3d68009040 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 msgr2=0x7f3d7813e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3d7001a3c0 tx=0x7f3d70019530 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 shutdown_connections 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d54068380 0x7f3d5406a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d78148070 0x7f3d7813e300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d78147c10 0x7f3d7809e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 --2- 172.21.15.16:0/4274371208 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d78075a70 0x7f3d781e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 >> 172.21.15.16:0/4274371208 conn(0x7f3d7809fab0 msgr2=0x7f3d78146390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 shutdown_connections 2024-04-26T22:22:04.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.094+0000 7f3d7d600640 1 -- 172.21.15.16:0/4274371208 wait complete. 2024-04-26T22:22:04.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:22:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.254+0000 7f68b7400640 1 Processor -- start 2024-04-26T22:22:04.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.254+0000 7f68b7400640 1 -- start start 2024-04-26T22:22:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 0x7f68b00b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b7400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 0x7f68b0142920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b7400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b00b73e0 con 0x7f68b00b7000 2024-04-26T22:22:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b7400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f68b00b6c00 con 0x7f68b0142490 2024-04-26T22:22:04.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b7400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f68b00b7750 con 0x7f68b006d1d0 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b5400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 0x7f68b0142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68afe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 0x7f68b00b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b5400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 0x7f68b0142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:53200/0 (socket says 172.21.15.16:53200) 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68b5400640 1 -- 172.21.15.16:0/107867311 learned_addr learned my addr 172.21.15.16:0/107867311 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68afe00640 1 -- 172.21.15.16:0/107867311 >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 msgr2=0x7f68b0142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68af400640 1 -- 172.21.15.16:0/107867311 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137893754 0 0) 0x7f68b00b73e0 con 0x7f68b00b7000 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68afe00640 1 --2- 172.21.15.16:0/107867311 >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 0x7f68b0142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68afe00640 1 -- 172.21.15.16:0/107867311 >> v1:172.21.15.195:6789/0 conn(0x7f68b00b7000 legacy=0x7f68b00b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.258+0000 7f68afe00640 1 -- 172.21.15.16:0/107867311 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b00b7ab0 con 0x7f68b006d1d0 2024-04-26T22:22:04.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68afe00640 1 --2- 172.21.15.16:0/107867311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 0x7f68b00b66c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f689c0097c0 tx=0x7f689c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328bc6fd233bb347 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68af400640 1 -- 172.21.15.16:0/107867311 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0b0070 con 0x7f68b006d1d0 2024-04-26T22:22:04.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68af400640 1 -- 172.21.15.16:0/107867311 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c0ab600 con 0x7f68b006d1d0 2024-04-26T22:22:04.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68af400640 1 -- 172.21.15.16:0/107867311 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c0ab9d0 con 0x7f68b006d1d0 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- 172.21.15.16:0/107867311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 msgr2=0x7f68b00b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- 172.21.15.16:0/107867311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 0x7f68b00b66c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f689c0097c0 tx=0x7f689c01c410 comp rx=0 tx=0).stop 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- 172.21.15.16:0/107867311 shutdown_connections 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- 172.21.15.16:0/107867311 >> v2:172.21.15.195:3300/0 conn(0x7f68b0142490 0x7f68b0142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- 172.21.15.16:0/107867311 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b006d1d0 0x7f68b00b66c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- 172.21.15.16:0/107867311 >> 172.21.15.16:0/107867311 conn(0x7f68b006f3d0 msgr2=0x7f68b006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- 172.21.15.16:0/107867311 shutdown_connections 2024-04-26T22:22:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- 172.21.15.16:0/107867311 wait complete. 2024-04-26T22:22:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 Processor -- start 2024-04-26T22:22:04.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- start start 2024-04-26T22:22:04.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b00b7000 0x7f68b01350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b0142490 0x7f68b00bab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01559d0 con 0x7f68b006d1d0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0155850 con 0x7f68b0142490 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.262+0000 7f68b7400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f68b0155b50 con 0x7f68b00b7000 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57670/0 (socket says 172.21.15.16:57670) 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 -- 172.21.15.16:0/1083277179 learned_addr learned my addr 172.21.15.16:0/1083277179 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b5400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b0142490 0x7f68b00bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68afe00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b00b7000 0x7f68b01350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 -- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b00b7000 msgr2=0x7f68b01350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b00b7000 0x7f68b01350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 -- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b0142490 msgr2=0x7f68b00bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b0142490 0x7f68b00bab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 -- 172.21.15.16:0/1083277179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b01e4ab0 con 0x7f68b006d1d0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b4a00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f68a400c4d0 tx=0x7f68a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4017070 con 0x7f68b006d1d0 2024-04-26T22:22:04.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4005480 con 0x7f68b006d1d0 2024-04-26T22:22:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4003840 con 0x7f68b006d1d0 2024-04-26T22:22:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b00a1860 con 0x7f68b006d1d0 2024-04-26T22:22:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b0152b90 con 0x7f68b006d1d0 2024-04-26T22:22:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b0069530 con 0x7f68b006d1d0 2024-04-26T22:22:04.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68a401a070 con 0x7f68b006d1d0 2024-04-26T22:22:04.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.266+0000 7f68acc00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 0x7f689006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.270+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f68a4085a30 con 0x7f68b006d1d0 2024-04-26T22:22:04.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.270+0000 7f68afe00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 0x7f689006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.270+0000 7f68afe00640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 0x7f689006a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f689c0ad000 tx=0x7f689c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.270+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f68a4055d10 con 0x7f68b006d1d0 2024-04-26T22:22:04.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.438+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f68b013d990 con 0x7f68b006d1d0 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.438+0000 7f68acc00640 1 -- 172.21.15.16:0/1083277179 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f68a405a010 con 0x7f68b006d1d0 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:04.443 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 msgr2=0x7f689006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 0x7f689006a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f689c0ad000 tx=0x7f689c008040 comp rx=0 tx=0).stop 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 msgr2=0x7f68b01e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f68a400c4d0 tx=0x7f68a400c990 comp rx=0 tx=0).stop 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 shutdown_connections 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f68900683b0 0x7f689006a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68b0142490 0x7f68b00bab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68b00b7000 0x7f68b01350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 --2- 172.21.15.16:0/1083277179 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68b006d1d0 0x7f68b01e4120 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 >> 172.21.15.16:0/1083277179 conn(0x7f68b006f3d0 msgr2=0x7f68b0072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 shutdown_connections 2024-04-26T22:22:04.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.442+0000 7f68b7400640 1 -- 172.21.15.16:0/1083277179 wait complete. 2024-04-26T22:22:04.465 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:22:04.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:22:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 Processor -- start 2024-04-26T22:22:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 -- start start 2024-04-26T22:22:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14941428d0 0x7f1494073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1494148510 0x7f1494148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1494142cb0 con 0x7f149414c060 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1494148eb0 con 0x7f1494148510 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f149be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1494149100 con 0x7f14941428d0 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1494148510 0x7f1494148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1494148510 0x7f1494148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42750/0 (socket says 172.21.15.16:42750) 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 -- 172.21.15.16:0/4267586327 learned_addr learned my addr 172.21.15.16:0/4267586327 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1499400640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14941428d0 0x7f1494073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 -- 172.21.15.16:0/4267586327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14941428d0 msgr2=0x7f1494073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14941428d0 0x7f1494073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 -- 172.21.15.16:0/4267586327 >> v1:172.21.15.195:6789/0 conn(0x7f149414c060 legacy=0x7f149409fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.606+0000 7f1498a00640 1 -- 172.21.15.16:0/4267586327 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14940b9720 con 0x7f1494148510 2024-04-26T22:22:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f1498a00640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1494148510 0x7f1494148970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21f3751f658be32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f1493e00640 1 -- 172.21.15.16:0/4267586327 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800aa600 con 0x7f1494148510 2024-04-26T22:22:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f1493e00640 1 -- 172.21.15.16:0/4267586327 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14800af070 con 0x7f1494148510 2024-04-26T22:22:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f1493e00640 1 -- 172.21.15.16:0/4267586327 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14800aa9c0 con 0x7f1494148510 2024-04-26T22:22:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 -- 172.21.15.16:0/4267586327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1494148510 msgr2=0x7f1494148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1494148510 0x7f1494148970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1480009870 tx=0x7f148001c4a0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 -- 172.21.15.16:0/4267586327 shutdown_connections 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1494148510 0x7f1494148970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 --2- 172.21.15.16:0/4267586327 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14941428d0 0x7f1494073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 -- 172.21.15.16:0/4267586327 >> 172.21.15.16:0/4267586327 conn(0x7f14940b8850 msgr2=0x7f14940b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 -- 172.21.15.16:0/4267586327 shutdown_connections 2024-04-26T22:22:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.610+0000 7f149be00640 1 -- 172.21.15.16:0/4267586327 wait complete. 2024-04-26T22:22:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 Processor -- start 2024-04-26T22:22:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- start start 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 0x7f14940b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f149414ca00 con 0x7f149414c060 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f149414c880 con 0x7f14941428d0 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1494155e50 con 0x7f1494148510 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1498a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 0x7f14940b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:37222/0 (socket says 172.21.15.16:37222) 2024-04-26T22:22:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 -- 172.21.15.16:0/684437769 learned_addr learned my addr 172.21.15.16:0/684437769 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42758/0 (socket says 172.21.15.16:42758) 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 -- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 msgr2=0x7f14940b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 0x7f14940b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 -- 172.21.15.16:0/684437769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 msgr2=0x7f1494143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 -- 172.21.15.16:0/684437769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149414b8f0 con 0x7f14941428d0 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499e00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1498a00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 0x7f14940b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1499400640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f148800d800 tx=0x7f148800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148800b6c0 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488019070 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148800bae0 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149414b0f0 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1494142e80 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.614+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1494069530 con 0x7f14941428d0 2024-04-26T22:22:04.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.618+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f148800bc80 con 0x7f14941428d0 2024-04-26T22:22:04.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.618+0000 7f1491600640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 0x7f147406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:04.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.618+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f1488086a00 con 0x7f14941428d0 2024-04-26T22:22:04.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.618+0000 7f1498a00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 0x7f147406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:04.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.618+0000 7f1498a00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 0x7f147406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14800ae000 tx=0x7f14800a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:04.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.622+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1488056cb0 con 0x7f14941428d0 2024-04-26T22:22:04.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:04.786+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f14940b9ef0 con 0x7f14941428d0 2024-04-26T22:22:05.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.542+0000 7f1491600640 1 -- 172.21.15.16:0/684437769 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f148805afb0 con 0x7f14941428d0 2024-04-26T22:22:05.546 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-26T22:22:05.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 msgr2=0x7f147406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:05.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 0x7f147406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14800ae000 tx=0x7f14800a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:05.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 msgr2=0x7f1494145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f148800d800 tx=0x7f148800dcc0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 shutdown_connections 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f14740683b0 0x7f147406a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f149414c060 0x7f1494143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1494148510 0x7f14940b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 --2- 172.21.15.16:0/684437769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14941428d0 0x7f1494145a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 >> 172.21.15.16:0/684437769 conn(0x7f14940b8850 msgr2=0x7f1494070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:05.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 shutdown_connections 2024-04-26T22:22:05.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.546+0000 7f149be00640 1 -- 172.21.15.16:0/684437769 wait complete. 2024-04-26T22:22:05.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:22:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 Processor -- start 2024-04-26T22:22:05.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 -- start start 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5618073860 0x7f5618142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56180b7880 0x7f5618070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56180a12d0 con 0x7f5618142980 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f56180b7210 con 0x7f5618073860 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561fa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f56180b76a0 con 0x7f56180b7880 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5618073860 0x7f5618142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5618073860 0x7f5618142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42762/0 (socket says 172.21.15.16:42762) 2024-04-26T22:22:05.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 -- 172.21.15.16:0/3916131502 learned_addr learned my addr 172.21.15.16:0/3916131502 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:05.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 -- 172.21.15.16:0/3916131502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56180b7880 msgr2=0x7f5618070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:05.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 --2- 172.21.15.16:0/3916131502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56180b7880 0x7f5618070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 -- 172.21.15.16:0/3916131502 >> v1:172.21.15.195:6789/0 conn(0x7f5618142980 legacy=0x7f561809fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:05.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.726+0000 7f561d000640 1 -- 172.21.15.16:0/3916131502 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56180b6ed0 con 0x7f5618073860 2024-04-26T22:22:05.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561d000640 1 --2- 172.21.15.16:0/3916131502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618073860 0x7f5618142440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f560c009870 tx=0x7f560c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb8f1647afec2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:05.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f5617400640 1 -- 172.21.15.16:0/3916131502 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a7070 con 0x7f5618073860 2024-04-26T22:22:05.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f5617400640 1 -- 172.21.15.16:0/3916131502 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c0b0070 con 0x7f5618073860 2024-04-26T22:22:05.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f5617400640 1 -- 172.21.15.16:0/3916131502 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0ab890 con 0x7f5618073860 2024-04-26T22:22:05.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 -- 172.21.15.16:0/3916131502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618073860 msgr2=0x7f5618142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 --2- 172.21.15.16:0/3916131502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618073860 0x7f5618142440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f560c009870 tx=0x7f560c01c490 comp rx=0 tx=0).stop 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 -- 172.21.15.16:0/3916131502 shutdown_connections 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 --2- 172.21.15.16:0/3916131502 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56180b7880 0x7f5618070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 --2- 172.21.15.16:0/3916131502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618073860 0x7f5618142440 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 -- 172.21.15.16:0/3916131502 >> 172.21.15.16:0/3916131502 conn(0x7f56180b8850 msgr2=0x7f56180b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 -- 172.21.15.16:0/3916131502 shutdown_connections 2024-04-26T22:22:05.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.730+0000 7f561fa00640 1 -- 172.21.15.16:0/3916131502 wait complete. 2024-04-26T22:22:05.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 Processor -- start 2024-04-26T22:22:05.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- start start 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5618073860 0x7f56181e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5618148ef0 0x7f5618147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5618071280 con 0x7f5618142980 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5618071100 con 0x7f5618148ef0 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5618155e10 con 0x7f5618073860 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:05.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42774/0 (socket says 172.21.15.16:42774) 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 -- 172.21.15.16:0/2287085412 learned_addr learned my addr 172.21.15.16:0/2287085412 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561d000640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5618073860 0x7f56181e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561da00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5618148ef0 0x7f5618147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 -- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5618073860 msgr2=0x7f56181e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5618073860 0x7f56181e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 -- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5618148ef0 msgr2=0x7f5618147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5618148ef0 0x7f5618147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 -- 172.21.15.16:0/2287085412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5618143020 con 0x7f5618142980 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5617e00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f560400b440 tx=0x7f560400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604015020 con 0x7f5618142980 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040118b0 con 0x7f5618142980 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604011ca0 con 0x7f5618142980 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56181e4f90 con 0x7f5618142980 2024-04-26T22:22:05.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561813ef30 con 0x7f5618142980 2024-04-26T22:22:05.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.734+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5618069530 con 0x7f5618142980 2024-04-26T22:22:05.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.738+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5604018020 con 0x7f5618142980 2024-04-26T22:22:05.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.738+0000 7f5614c00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 0x7f55f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:05.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.738+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f5604086d90 con 0x7f5618142980 2024-04-26T22:22:05.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.738+0000 7f561d000640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 0x7f55f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:05.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.738+0000 7f561d000640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 0x7f55f806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f560c0af000 tx=0x7f560c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:05.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.742+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f560401f020 con 0x7f5618142980 2024-04-26T22:22:05.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:05.906+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f561809fe20 con 0x7f5618142980 2024-04-26T22:22:06.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.546+0000 7f5614c00640 1 -- 172.21.15.16:0/2287085412 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f560400d040 con 0x7f5618142980 2024-04-26T22:22:06.549 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 msgr2=0x7f55f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 0x7f55f806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f560c0af000 tx=0x7f560c0a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 msgr2=0x7f5618146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f560400b440 tx=0x7f560400b900 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 shutdown_connections 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f55f8068380 0x7f55f806a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5618148ef0 0x7f5618147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5618142980 0x7f5618146e50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 --2- 172.21.15.16:0/2287085412 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5618073860 0x7f56181e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 >> 172.21.15.16:0/2287085412 conn(0x7f56180b8850 msgr2=0x7f56180b9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 shutdown_connections 2024-04-26T22:22:06.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.550+0000 7f561fa00640 1 -- 172.21.15.16:0/2287085412 wait complete. 2024-04-26T22:22:06.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:22:06.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 Processor -- start 2024-04-26T22:22:06.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 -- start start 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9241465c0 0x7fc9240b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc92413eec0 0x7fc92413f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92413f850 con 0x7fc92406e410 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc924070a40 con 0x7fc92413eec0 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc929000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc92406e7f0 con 0x7fc9241465c0 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc92413eec0 0x7fc92413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc92413eec0 0x7fc92413f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42776/0 (socket says 172.21.15.16:42776) 2024-04-26T22:22:06.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 -- 172.21.15.16:0/3186154501 learned_addr learned my addr 172.21.15.16:0/3186154501 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc91be00640 1 --2- 172.21.15.16:0/3186154501 >> v2:172.21.15.195:3300/0 conn(0x7fc9241465c0 0x7fc9240b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 -- 172.21.15.16:0/3186154501 >> v2:172.21.15.195:3300/0 conn(0x7fc9241465c0 msgr2=0x7fc9240b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 --2- 172.21.15.16:0/3186154501 >> v2:172.21.15.195:3300/0 conn(0x7fc9241465c0 0x7fc9240b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 -- 172.21.15.16:0/3186154501 >> v1:172.21.15.195:6789/0 conn(0x7fc92406e410 legacy=0x7fc924149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.734+0000 7fc922800640 1 -- 172.21.15.16:0/3186154501 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc924070760 con 0x7fc92413eec0 2024-04-26T22:22:06.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc922800640 1 --2- 172.21.15.16:0/3186154501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92413eec0 0x7fc92413f310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc9240b7450 tx=0x7fc91c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731649bb2c2dbf59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:06.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc921400640 1 -- 172.21.15.16:0/3186154501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0a5710 con 0x7fc92413eec0 2024-04-26T22:22:06.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc921400640 1 -- 172.21.15.16:0/3186154501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c0a58b0 con 0x7fc92413eec0 2024-04-26T22:22:06.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc921400640 1 -- 172.21.15.16:0/3186154501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0a5c80 con 0x7fc92413eec0 2024-04-26T22:22:06.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- 172.21.15.16:0/3186154501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92413eec0 msgr2=0x7fc92413f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 --2- 172.21.15.16:0/3186154501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92413eec0 0x7fc92413f310 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc9240b7450 tx=0x7fc91c01c960 comp rx=0 tx=0).stop 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- 172.21.15.16:0/3186154501 shutdown_connections 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 --2- 172.21.15.16:0/3186154501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92413eec0 0x7fc92413f310 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 --2- 172.21.15.16:0/3186154501 >> v2:172.21.15.195:3300/0 conn(0x7fc9241465c0 0x7fc9240b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- 172.21.15.16:0/3186154501 >> 172.21.15.16:0/3186154501 conn(0x7fc9240b6590 msgr2=0x7fc9240b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- 172.21.15.16:0/3186154501 shutdown_connections 2024-04-26T22:22:06.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- 172.21.15.16:0/3186154501 wait complete. 2024-04-26T22:22:06.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 Processor -- start 2024-04-26T22:22:06.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.738+0000 7fc929000640 1 -- start start 2024-04-26T22:22:06.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92406e410 0x7fc92413b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92413eec0 0x7fc9241e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc924152600 con 0x7fc9241465c0 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc924152480 con 0x7fc92413eec0 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc924152780 con 0x7fc92406e410 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42780/0 (socket says 172.21.15.16:42780) 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 -- 172.21.15.16:0/1578845219 learned_addr learned my addr 172.21.15.16:0/1578845219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc921e00640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92406e410 0x7fc92413b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc91be00640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92413eec0 0x7fc9241e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 -- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92406e410 msgr2=0x7fc92413b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92406e410 0x7fc92413b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 -- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92413eec0 msgr2=0x7fc9241e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:06.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92413eec0 0x7fc9241e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 -- 172.21.15.16:0/1578845219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc924141ca0 con 0x7fc9241465c0 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc922800640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0af040 tx=0x7fc91c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0bc020 con 0x7fc9241465c0 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c0b8690 con 0x7fc9241465c0 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0b8a80 con 0x7fc9241465c0 2024-04-26T22:22:06.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc924135a70 con 0x7fc9241465c0 2024-04-26T22:22:06.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9241421f0 con 0x7fc9241465c0 2024-04-26T22:22:06.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc924069530 con 0x7fc9241465c0 2024-04-26T22:22:06.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.742+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc91c0bf020 con 0x7fc9241465c0 2024-04-26T22:22:06.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.746+0000 7fc91a000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 0x7fc90006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:06.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.746+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7fc91c1214d0 con 0x7fc9241465c0 2024-04-26T22:22:06.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.746+0000 7fc921e00640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 0x7fc90006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:06.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.746+0000 7fc921e00640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 0x7fc90006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc92413c510 tx=0x7fc914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:06.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.750+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc91c0c6070 con 0x7fc9241465c0 2024-04-26T22:22:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:06.950+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc924141f10 con 0x7fc9241465c0 2024-04-26T22:22:07.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.546+0000 7fc91a000640 1 -- 172.21.15.16:0/1578845219 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fc91c0165e0 con 0x7fc9241465c0 2024-04-26T22:22:07.552 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T22:22:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 msgr2=0x7fc90006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 0x7fc90006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc92413c510 tx=0x7fc914009040 comp rx=0 tx=0).stop 2024-04-26T22:22:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 msgr2=0x7fc924134830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0af040 tx=0x7fc91c019700 comp rx=0 tx=0).stop 2024-04-26T22:22:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 shutdown_connections 2024-04-26T22:22:07.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc900068380 0x7fc90006a840 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc92413c510 tx=0x7fc914009040 comp rx=0 tx=0).stop 2024-04-26T22:22:07.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9241465c0 0x7fc924134830 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc92413eec0 0x7fc9241e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 --2- 172.21.15.16:0/1578845219 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc92406e410 0x7fc92413b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.550+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 >> 172.21.15.16:0/1578845219 conn(0x7fc9240b6590 msgr2=0x7fc92414e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:07.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.554+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 shutdown_connections 2024-04-26T22:22:07.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.554+0000 7fc929000640 1 -- 172.21.15.16:0/1578845219 wait complete. 2024-04-26T22:22:07.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.742+0000 7f786e600640 1 Processor -- start 2024-04-26T22:22:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.742+0000 7f786e600640 1 -- start start 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f786e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f786e600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78680b0ac0 0x7f78681405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f786e600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786806e830 con 0x7f786806e450 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f786e600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f78680b3310 con 0x7f78680b0ac0 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f786e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7868070790 con 0x7f78680b58d0 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78680b0ac0 0x7f78681405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f78680b0ac0 0x7f78681405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42790/0 (socket says 172.21.15.16:42790) 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f786806e450 0x7f78680b3a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48016/0 (socket says 172.21.15.16:48016) 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 -- 172.21.15.16:0/3762672050 learned_addr learned my addr 172.21.15.16:0/3762672050 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f785ea00640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 -- 172.21.15.16:0/3762672050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 msgr2=0x7f7868140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 -- 172.21.15.16:0/3762672050 >> v1:172.21.15.16:6789/0 conn(0x7f786806e450 legacy=0x7f78680b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 -- 172.21.15.16:0/3762672050 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78680b5f00 con 0x7f78680b0ac0 2024-04-26T22:22:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7866a00640 1 -- 172.21.15.16:0/3762672050 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144048328 0 0) 0x7f786806e830 con 0x7f786806e450 2024-04-26T22:22:07.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.746+0000 7f7867e00640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78681405a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7860009e50 tx=0x7f786001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24285135153640b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:07.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7866a00640 1 -- 172.21.15.16:0/3762672050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5830 con 0x7f78680b0ac0 2024-04-26T22:22:07.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7866a00640 1 -- 172.21.15.16:0/3762672050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600a59d0 con 0x7f78680b0ac0 2024-04-26T22:22:07.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7866a00640 1 -- 172.21.15.16:0/3762672050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5da0 con 0x7f78680b0ac0 2024-04-26T22:22:07.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- 172.21.15.16:0/3762672050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 msgr2=0x7f78681405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78681405a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7860009e50 tx=0x7f786001c970 comp rx=0 tx=0).stop 2024-04-26T22:22:07.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- 172.21.15.16:0/3762672050 shutdown_connections 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78681405a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- 172.21.15.16:0/3762672050 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- 172.21.15.16:0/3762672050 >> 172.21.15.16:0/3762672050 conn(0x7f78680b6620 msgr2=0x7f78680b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- 172.21.15.16:0/3762672050 shutdown_connections 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- 172.21.15.16:0/3762672050 wait complete. 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 Processor -- start 2024-04-26T22:22:07.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- start start 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 0x7f78680b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868072d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7868153700 con 0x7f78680b0ac0 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7868153580 con 0x7f786806e450 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f786e600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7868153880 con 0x7f78680b58d0 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42792/0 (socket says 172.21.15.16:42792) 2024-04-26T22:22:07.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 -- 172.21.15.16:0/259553991 learned_addr learned my addr 172.21.15.16:0/259553991 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7867e00640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7867400640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 0x7f78680b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 -- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 msgr2=0x7f7868072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 -- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 msgr2=0x7f78680b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 0x7f78680b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f785ea00640 1 -- 172.21.15.16:0/259553991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7868073a60 con 0x7f78680b0ac0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.750+0000 7f7867400640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 0x7f78680b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785ea00640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f785000e870 tx=0x7f785000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850017070 con 0x7f78680b0ac0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785000c940 con 0x7f78680b0ac0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7868073d40 con 0x7f78680b0ac0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785000ccf0 con 0x7f78680b0ac0 2024-04-26T22:22:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786813a120 con 0x7f78680b0ac0 2024-04-26T22:22:07.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7868069530 con 0x7f78680b0ac0 2024-04-26T22:22:07.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f785001a070 con 0x7f78680b0ac0 2024-04-26T22:22:07.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 0x7f784406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:07.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f7850086c50 con 0x7f78680b0ac0 2024-04-26T22:22:07.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.754+0000 7f7867400640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 0x7f784406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.758+0000 7f7867400640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 0x7f784406a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7858000f70 tx=0x7f7858009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.758+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7850057200 con 0x7f78680b0ac0 2024-04-26T22:22:07.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7868069f20 con 0x7f78680b0ac0 2024-04-26T22:22:07.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f785fe00640 1 -- 172.21.15.16:0/259553991 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16670 (secure 0 0 0) 0x7f7850056b00 con 0x7f78680b0ac0 2024-04-26T22:22:07.931 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:07.931 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:06.956044+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 msgr2=0x7f784406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 0x7f784406a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7858000f70 tx=0x7f7858009040 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 msgr2=0x7f78680727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.926+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f785000e870 tx=0x7f785000ec70 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 shutdown_connections 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7844068380 0x7f784406a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78680b58d0 0x7f7868072d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78680b0ac0 0x7f78680727f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 --2- 172.21.15.16:0/259553991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f786806e450 0x7f78680b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 >> 172.21.15.16:0/259553991 conn(0x7f78680b6620 msgr2=0x7f78681445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 shutdown_connections 2024-04-26T22:22:07.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:07.930+0000 7f786e600640 1 -- 172.21.15.16:0/259553991 wait complete. 2024-04-26T22:22:07.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:08.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 Processor -- start 2024-04-26T22:22:08.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 -- start start 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f837009ca20 0x7f83701454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8370075e80 con 0x7f83700b4c70 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700b5200 con 0x7f8370075aa0 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8375c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f83700b57c0 con 0x7f837009ca20 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f836f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f83700b4c70 0x7f8370145a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48020/0 (socket says 172.21.15.16:48020) 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f836f400640 1 -- 172.21.15.16:0/899689401 learned_addr learned my addr 172.21.15.16:0/899689401 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:08.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8367e00640 1 --2- 172.21.15.16:0/899689401 >> v2:172.21.15.195:3300/0 conn(0x7f837009ca20 0x7f83701454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237650134 0 0) 0x7f8370075e80 con 0x7f83700b4c70 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8354003530 con 0x7f83700b4c70 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8367e00640 1 -- 172.21.15.16:0/899689401 >> v1:172.21.15.195:6789/0 conn(0x7f8370075aa0 legacy=0x7f83700b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145866817 0 0) 0x7f83700b5200 con 0x7f8370075aa0 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8367e00640 1 -- 172.21.15.16:0/899689401 >> v1:172.21.15.16:6789/0 conn(0x7f83700b4c70 legacy=0x7f8370145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.090+0000 7f8367e00640 1 -- 172.21.15.16:0/899689401 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700b54e0 con 0x7f837009ca20 2024-04-26T22:22:08.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8367e00640 1 --2- 172.21.15.16:0/899689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837009ca20 0x7f83701454f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f83580097c0 tx=0x7f835801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13cd1db5af7ecced server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580b0070 con 0x7f837009ca20 2024-04-26T22:22:08.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83580ab600 con 0x7f837009ca20 2024-04-26T22:22:08.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f836e000640 1 -- 172.21.15.16:0/899689401 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580ab9b0 con 0x7f837009ca20 2024-04-26T22:22:08.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- 172.21.15.16:0/899689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837009ca20 msgr2=0x7f83701454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 --2- 172.21.15.16:0/899689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837009ca20 0x7f83701454f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f83580097c0 tx=0x7f835801c4a0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- 172.21.15.16:0/899689401 shutdown_connections 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 --2- 172.21.15.16:0/899689401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837009ca20 0x7f83701454f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- 172.21.15.16:0/899689401 >> 172.21.15.16:0/899689401 conn(0x7f83700ba2b0 msgr2=0x7f83700ba6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- 172.21.15.16:0/899689401 shutdown_connections 2024-04-26T22:22:08.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- 172.21.15.16:0/899689401 wait complete. 2024-04-26T22:22:08.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 Processor -- start 2024-04-26T22:22:08.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.094+0000 7f8375c00640 1 -- start start 2024-04-26T22:22:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 0x7f837009f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8370147700 0x7f83701e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8370156a10 con 0x7f83700b4c70 2024-04-26T22:22:08.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8370156b90 con 0x7f8370075aa0 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8370156d10 con 0x7f8370147700 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42804/0 (socket says 172.21.15.16:42804) 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 -- 172.21.15.16:0/4118043746 learned_addr learned my addr 172.21.15.16:0/4118043746 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f836f400640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8370147700 0x7f83701e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f836ea00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 0x7f837009f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 -- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8370147700 msgr2=0x7f83701e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8370147700 0x7f83701e4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 -- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 msgr2=0x7f837009f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 0x7f837009f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 -- 172.21.15.16:0/4118043746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700754e0 con 0x7f83700b4c70 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f836ea00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 0x7f837009f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8367e00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8358000c10 tx=0x7f8358019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580b9020 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83580ab9b0 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8370147be0 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580b0040 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8370072f80 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8370069b60 con 0x7f83700b4c70 2024-04-26T22:22:08.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.098+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f83580bc020 con 0x7f83700b4c70 2024-04-26T22:22:08.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.102+0000 7f8366a00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 0x7f834c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.102+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f8358120a50 con 0x7f83700b4c70 2024-04-26T22:22:08.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.102+0000 7f836ea00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 0x7f834c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.102+0000 7f836ea00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 0x7f834c06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8360000f70 tx=0x7f8360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.106+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f83580c3030 con 0x7f83700b4c70 2024-04-26T22:22:08.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.270+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83700b1fb0 con 0x7f83700b4c70 2024-04-26T22:22:08.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8366a00640 1 -- 172.21.15.16:0/4118043746 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16670 (secure 0 0 0) 0x7f8358016090 con 0x7f83700b4c70 2024-04-26T22:22:08.278 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:08.278 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:06.956044+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 msgr2=0x7f834c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 0x7f834c06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8360000f70 tx=0x7f8360009040 comp rx=0 tx=0).stop 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 msgr2=0x7f83701e45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8358000c10 tx=0x7f8358019240 comp rx=0 tx=0).stop 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 shutdown_connections 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f834c068380 0x7f834c06a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8370147700 0x7f83701e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83700b4c70 0x7f83701e45b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 --2- 172.21.15.16:0/4118043746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8370075aa0 0x7f837009f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 >> 172.21.15.16:0/4118043746 conn(0x7f83700ba2b0 msgr2=0x7f837009c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:08.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 shutdown_connections 2024-04-26T22:22:08.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.274+0000 7f8375c00640 1 -- 172.21.15.16:0/4118043746 wait complete. 2024-04-26T22:22:08.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:22:08.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 Processor -- start 2024-04-26T22:22:08.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 -- start start 2024-04-26T22:22:08.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f709c06ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f709c070450 0x7f709c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0708c0 con 0x7f709c0b9130 2024-04-26T22:22:08.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f709c0b6e60 con 0x7f709c070450 2024-04-26T22:22:08.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f70a2000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f709c0b9510 con 0x7f709c0b7730 2024-04-26T22:22:08.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f709c0b9130 0x7f709c142520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48036/0 (socket says 172.21.15.16:48036) 2024-04-26T22:22:08.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709b400640 1 -- 172.21.15.16:0/3574325632 learned_addr learned my addr 172.21.15.16:0/3574325632 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:08.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f7093e00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f709c06ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709be00640 1 --2- 172.21.15.16:0/3574325632 >> v2:172.21.15.195:3300/0 conn(0x7f709c070450 0x7f709c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204143193 0 0) 0x7f708c001120 con 0x7f709c0b9130 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7080003530 con 0x7f709c0b9130 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216844536 0 0) 0x7f7080003530 con 0x7f709c0b9130 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 msgr2=0x7f709c06ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f709c06ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 >> v2:172.21.15.195:3300/0 conn(0x7f709c070450 msgr2=0x7f709c152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 --2- 172.21.15.16:0/3574325632 >> v2:172.21.15.195:3300/0 conn(0x7f709c070450 0x7f709c152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c142c30 con 0x7f709c0b9130 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f708c001850 con 0x7f709c0b9130 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 >> v1:172.21.15.16:6789/0 conn(0x7f709c0b9130 legacy=0x7f709c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.438+0000 7f709aa00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f7080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f70800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0b6e60 con 0x7f7080004d50 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0b9510 con 0x7f70800039c0 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f708000b9d0 con 0x7f709c0b7730 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f70800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709b400640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f7093e00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f7080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 -- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 msgr2=0x7f7080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c0b7730 0x7f7080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 -- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70800039c0 msgr2=0x7f7080003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70800039c0 0x7f7080003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 -- 172.21.15.16:0/3574325632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7080003530 con 0x7f7080004d50 2024-04-26T22:22:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709be00640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f70800051d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f709400e170 tx=0x7f709401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6939a763eb544316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940b2070 con 0x7f7080004d50 2024-04-26T22:22:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70940a5cb0 con 0x7f7080004d50 2024-04-26T22:22:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.442+0000 7f709aa00640 1 -- 172.21.15.16:0/3574325632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094009c10 con 0x7f7080004d50 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- 172.21.15.16:0/3574325632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 msgr2=0x7f70800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 --2- 172.21.15.16:0/3574325632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f70800051d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f709400e170 tx=0x7f709401cca0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709be00640 1 -- 172.21.15.16:0/3574325632 reap_dead start 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- 172.21.15.16:0/3574325632 shutdown_connections 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- 172.21.15.16:0/3574325632 >> 172.21.15.16:0/3574325632 conn(0x7f709c0bc2c0 msgr2=0x7f709c0b87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- 172.21.15.16:0/3574325632 shutdown_connections 2024-04-26T22:22:08.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- 172.21.15.16:0/3574325632 wait complete. 2024-04-26T22:22:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 Processor -- start 2024-04-26T22:22:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- start start 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c1475c0 0x7f709c1dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 0x7f709c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0741b0 con 0x7f7080004d50 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f709c074030 con 0x7f709c14b900 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f70a2000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f709c071090 con 0x7f709c1475c0 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42832/0 (socket says 172.21.15.16:42832) 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 -- 172.21.15.16:0/2903832675 learned_addr learned my addr 172.21.15.16:0/2903832675 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709be00640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 0x7f709c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f7093e00640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c1475c0 0x7f709c1dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 -- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c1475c0 msgr2=0x7f709c1dddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c1475c0 0x7f709c1dddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 -- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 msgr2=0x7f709c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 0x7f709c14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709b400640 1 -- 172.21.15.16:0/2903832675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c146800 con 0x7f7080004d50 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.446+0000 7f709be00640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 0x7f709c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f709b400640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f708c007290 tx=0x7f708c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c00f960 con 0x7f7080004d50 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c018070 con 0x7f7080004d50 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c146ac0 con 0x7f7080004d50 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c00fd40 con 0x7f7080004d50 2024-04-26T22:22:08.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c1de300 con 0x7f7080004d50 2024-04-26T22:22:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c146c90 con 0x7f7080004d50 2024-04-26T22:22:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f708c01d460 con 0x7f7080004d50 2024-04-26T22:22:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 0x7f707806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f708c086a50 con 0x7f7080004d50 2024-04-26T22:22:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.450+0000 7f7093e00640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 0x7f707806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:08.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.454+0000 7f7093e00640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 0x7f707806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f709c0bbbf0 tx=0x7f7084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:08.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.458+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f709c146c90 con 0x7f7080004d50 2024-04-26T22:22:08.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:08.658+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f709c146e90 con 0x7f7080004d50 2024-04-26T22:22:09.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.570+0000 7f7093400640 1 -- 172.21.15.16:0/2903832675 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f709c0708c0 con 0x7f7080004d50 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 msgr2=0x7f707806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 0x7f707806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f709c0bbbf0 tx=0x7f7084008040 comp rx=0 tx=0).stop 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 msgr2=0x7f709c1d4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f708c007290 tx=0x7f708c007750 comp rx=0 tx=0).stop 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 shutdown_connections 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f70780683b0 0x7f707806a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f709c14b900 0x7f709c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f709c1475c0 0x7f709c1dddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 --2- 172.21.15.16:0/2903832675 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7080004d50 0x7f709c1d4150 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 >> 172.21.15.16:0/2903832675 conn(0x7f709c0bc2c0 msgr2=0x7f709c072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:09.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 shutdown_connections 2024-04-26T22:22:09.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.574+0000 7f70a2000640 1 -- 172.21.15.16:0/2903832675 wait complete. 2024-04-26T22:22:09.602 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:22:09.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:22:09.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 Processor -- start 2024-04-26T22:22:09.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 -- start start 2024-04-26T22:22:09.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f933c147c10 0x7f933c148070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c075e50 con 0x7f933c150e10 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c09ce70 con 0x7f933c075a70 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9343200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f933c09c9e0 con 0x7f933c147c10 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9333e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f933c147c10 0x7f933c148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9341200640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f933c150e10 0x7f933c153200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48050/0 (socket says 172.21.15.16:48050) 2024-04-26T22:22:09.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9341200640 1 -- 172.21.15.16:0/527734219 learned_addr learned my addr 172.21.15.16:0/527734219 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:09.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9333e00640 1 -- 172.21.15.16:0/527734219 >> v1:172.21.15.195:6789/0 conn(0x7f933c075a70 legacy=0x7f933c09ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9333e00640 1 -- 172.21.15.16:0/527734219 >> v1:172.21.15.16:6789/0 conn(0x7f933c150e10 legacy=0x7f933c153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.746+0000 7f9333e00640 1 -- 172.21.15.16:0/527734219 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0b5f90 con 0x7f933c147c10 2024-04-26T22:22:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9333e00640 1 --2- 172.21.15.16:0/527734219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c147c10 0x7f933c148070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f933c09cb60 tx=0x7f932401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e62101616aaeab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f933b400640 1 -- 172.21.15.16:0/527734219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240b0070 con 0x7f933c147c10 2024-04-26T22:22:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f933b400640 1 -- 172.21.15.16:0/527734219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93240ab600 con 0x7f933c147c10 2024-04-26T22:22:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f933b400640 1 -- 172.21.15.16:0/527734219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240ab9d0 con 0x7f933c147c10 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- 172.21.15.16:0/527734219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c147c10 msgr2=0x7f933c148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 --2- 172.21.15.16:0/527734219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c147c10 0x7f933c148070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f933c09cb60 tx=0x7f932401c360 comp rx=0 tx=0).stop 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- 172.21.15.16:0/527734219 shutdown_connections 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 --2- 172.21.15.16:0/527734219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c147c10 0x7f933c148070 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- 172.21.15.16:0/527734219 >> 172.21.15.16:0/527734219 conn(0x7f933c09fab0 msgr2=0x7f933c0ba2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:09.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- 172.21.15.16:0/527734219 shutdown_connections 2024-04-26T22:22:09.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- 172.21.15.16:0/527734219 wait complete. 2024-04-26T22:22:09.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 Processor -- start 2024-04-26T22:22:09.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.750+0000 7f9343200640 1 -- start start 2024-04-26T22:22:09.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f933c075a70 0x7f933c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:09.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f933c147c10 0x7f933c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:09.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0bb0f0 con 0x7f933c150e10 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0b5c10 con 0x7f933c075a70 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0b5880 con 0x7f933c147c10 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42852/0 (socket says 172.21.15.16:42852) 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 -- 172.21.15.16:0/3919659975 learned_addr learned my addr 172.21.15.16:0/3919659975 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9333e00640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f933c147c10 0x7f933c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:09.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f933be00640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f933c075a70 0x7f933c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 -- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f933c147c10 msgr2=0x7f933c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f933c147c10 0x7f933c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 -- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f933c075a70 msgr2=0x7f933c1496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f933c075a70 0x7f933c1496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 -- 172.21.15.16:0/3919659975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c1439b0 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9341200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f933400cad0 tx=0x7f933400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334017070 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933400ab10 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334012400 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c143c90 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c14b330 con 0x7f933c150e10 2024-04-26T22:22:09.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.754+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c069530 con 0x7f933c150e10 2024-04-26T22:22:09.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.758+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f933401a070 con 0x7f933c150e10 2024-04-26T22:22:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.758+0000 7f9338c00640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 0x7f931806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.758+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f93340864c0 con 0x7f933c150e10 2024-04-26T22:22:09.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.758+0000 7f933be00640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 0x7f931806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:09.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.758+0000 7f933be00640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 0x7f931806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f932c001810 tx=0x7f932c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:09.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.762+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9334056420 con 0x7f933c150e10 2024-04-26T22:22:09.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:09.962+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f933c0b4920 con 0x7f933c150e10 2024-04-26T22:22:10.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9338c00640 1 -- 172.21.15.16:0/3919659975 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f933405a720 con 0x7f933c150e10 2024-04-26T22:22:10.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 msgr2=0x7f931806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 0x7f931806a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f932c001810 tx=0x7f932c009040 comp rx=0 tx=0).stop 2024-04-26T22:22:10.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 msgr2=0x7f933c153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f933400cad0 tx=0x7f933400cf90 comp rx=0 tx=0).stop 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 shutdown_connections 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f93180683b0 0x7f931806a870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f933c150e10 0x7f933c153620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f933c147c10 0x7f933c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 --2- 172.21.15.16:0/3919659975 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f933c075a70 0x7f933c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 >> 172.21.15.16:0/3919659975 conn(0x7f933c09fab0 msgr2=0x7f933c0af300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 shutdown_connections 2024-04-26T22:22:10.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.578+0000 7f9343200640 1 -- 172.21.15.16:0/3919659975 wait complete. 2024-04-26T22:22:10.607 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:22:10.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.746+0000 7f9c4c600640 1 Processor -- start 2024-04-26T22:22:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.746+0000 7f9c4c600640 1 -- start start 2024-04-26T22:22:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4c600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c440b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4c600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c440b58d0 0x7f9c44140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4c600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c440b3f50 con 0x7f9c440b0ac0 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4c600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9c440b3310 con 0x7f9c440b58d0 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4c600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9c44070790 con 0x7f9c4406e450 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c440b58d0 0x7f9c44140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4a600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9c440b0ac0 0x7f9c440b4520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48064/0 (socket says 172.21.15.16:48064) 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c4a600640 1 -- 172.21.15.16:0/2732957358 learned_addr learned my addr 172.21.15.16:0/2732957358 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49c00640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c440b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 -- 172.21.15.16:0/2732957358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 msgr2=0x7f9c440b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c440b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 -- 172.21.15.16:0/2732957358 >> v1:172.21.15.16:6789/0 conn(0x7f9c440b0ac0 legacy=0x7f9c440b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 -- 172.21.15.16:0/2732957358 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4406e830 con 0x7f9c440b58d0 2024-04-26T22:22:10.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c49200640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c44140060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097c0 tx=0x7f9c3001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3d9ebe460ed305 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c43e00640 1 -- 172.21.15.16:0/2732957358 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300b1070 con 0x7f9c440b58d0 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c43e00640 1 -- 172.21.15.16:0/2732957358 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300a8050 con 0x7f9c440b58d0 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.750+0000 7f9c43e00640 1 -- 172.21.15.16:0/2732957358 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300ac860 con 0x7f9c440b58d0 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- 172.21.15.16:0/2732957358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 msgr2=0x7f9c44140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c44140060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097c0 tx=0x7f9c3001c3e0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- 172.21.15.16:0/2732957358 shutdown_connections 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c44140060 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- 172.21.15.16:0/2732957358 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c440b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- 172.21.15.16:0/2732957358 >> 172.21.15.16:0/2732957358 conn(0x7f9c440b6620 msgr2=0x7f9c440b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:10.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- 172.21.15.16:0/2732957358 shutdown_connections 2024-04-26T22:22:10.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- 172.21.15.16:0/2732957358 wait complete. 2024-04-26T22:22:10.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 Processor -- start 2024-04-26T22:22:10.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- start start 2024-04-26T22:22:10.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c44072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c440b0ac0 0x7f9c440b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44153b70 con 0x7f9c440b58d0 2024-04-26T22:22:10.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44070420 con 0x7f9c440b0ac0 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4c600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f9c44153cf0 con 0x7f9c4406e450 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42868/0 (socket says 172.21.15.16:42868) 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 -- 172.21.15.16:0/3131895016 learned_addr learned my addr 172.21.15.16:0/3131895016 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c49c00640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c44072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c49200640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c440b0ac0 0x7f9c440b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 -- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 msgr2=0x7f9c44072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c44072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 -- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c440b0ac0 msgr2=0x7f9c440b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c440b0ac0 0x7f9c440b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 -- 172.21.15.16:0/3131895016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c440b3000 con 0x7f9c440b58d0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.754+0000 7f9c4a600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00caa0 tx=0x7f9c3c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c017070 con 0x7f9c440b58d0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00aba0 con 0x7f9c440b58d0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c012400 con 0x7f9c440b58d0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c44073a80 con 0x7f9c440b58d0 2024-04-26T22:22:10.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c440b7920 con 0x7f9c440b58d0 2024-04-26T22:22:10.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44069530 con 0x7f9c440b58d0 2024-04-26T22:22:10.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c3c01a070 con 0x7f9c440b58d0 2024-04-26T22:22:10.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 0x7f9c2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:10.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9c3c086570 con 0x7f9c440b58d0 2024-04-26T22:22:10.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.758+0000 7f9c49c00640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 0x7f9c2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:10.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.762+0000 7f9c49c00640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 0x7f9c2406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800b9d0 tx=0x7f9c38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:10.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.762+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9c3c0564d0 con 0x7f9c440b58d0 2024-04-26T22:22:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c4413e8a0 con 0x7f9c440b58d0 2024-04-26T22:22:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c41600640 1 -- 172.21.15.16:0/3131895016 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7f9c3c084e20 con 0x7f9c440b58d0 2024-04-26T22:22:10.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:10.966 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:10.966 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 msgr2=0x7f9c2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 0x7f9c2406a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800b9d0 tx=0x7f9c38008040 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 msgr2=0x7f9c441e4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00caa0 tx=0x7f9c3c00cf60 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 shutdown_connections 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f9c24068380 0x7f9c2406a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c440b58d0 0x7f9c441e4840 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9c440b0ac0 0x7f9c440b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 --2- 172.21.15.16:0/3131895016 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9c4406e450 0x7f9c44072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 >> 172.21.15.16:0/3131895016 conn(0x7f9c440b6620 msgr2=0x7f9c44139b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 shutdown_connections 2024-04-26T22:22:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:10.962+0000 7f9c4c600640 1 -- 172.21.15.16:0/3131895016 wait complete. 2024-04-26T22:22:10.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:11.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.122+0000 7f3998a00640 1 Processor -- start 2024-04-26T22:22:11.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.122+0000 7f3998a00640 1 -- start start 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3998a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399406e450 0x7f39940b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3998a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f399414dac0 0x7f399414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3998a00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f399406e830 con 0x7f399413ef30 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3998a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f39940b0d10 con 0x7f399406e450 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3998a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f39940b0a30 con 0x7f399414dac0 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399406e450 0x7f39940b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399406e450 0x7f39940b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42880/0 (socket says 172.21.15.16:42880) 2024-04-26T22:22:11.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 -- 172.21.15.16:0/4266478398 learned_addr learned my addr 172.21.15.16:0/4266478398 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 -- 172.21.15.16:0/4266478398 >> v2:172.21.15.195:3300/0 conn(0x7f399414dac0 msgr2=0x7f399414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 --2- 172.21.15.16:0/4266478398 >> v2:172.21.15.195:3300/0 conn(0x7f399414dac0 0x7f399414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 -- 172.21.15.16:0/4266478398 >> v1:172.21.15.195:6789/0 conn(0x7f399413ef30 legacy=0x7f399413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 -- 172.21.15.16:0/4266478398 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39940b2cf0 con 0x7f399406e450 2024-04-26T22:22:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.126+0000 7f3991e00640 1 --2- 172.21.15.16:0/4266478398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399406e450 0x7f39940b1020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39940b0e90 tx=0x7f398401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4a2adbd7626905 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3991400640 1 -- 172.21.15.16:0/4266478398 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840b0070 con 0x7f399406e450 2024-04-26T22:22:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3991400640 1 -- 172.21.15.16:0/4266478398 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39840ab600 con 0x7f399406e450 2024-04-26T22:22:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3991400640 1 -- 172.21.15.16:0/4266478398 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840ab9d0 con 0x7f399406e450 2024-04-26T22:22:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- 172.21.15.16:0/4266478398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399406e450 msgr2=0x7f39940b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- 172.21.15.16:0/4266478398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399406e450 0x7f39940b1020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f39940b0e90 tx=0x7f398401c3c0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- 172.21.15.16:0/4266478398 shutdown_connections 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- 172.21.15.16:0/4266478398 >> v2:172.21.15.195:3300/0 conn(0x7f399414dac0 0x7f399414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- 172.21.15.16:0/4266478398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399406e450 0x7f39940b1020 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- 172.21.15.16:0/4266478398 >> 172.21.15.16:0/4266478398 conn(0x7f39940b6620 msgr2=0x7f39940b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- 172.21.15.16:0/4266478398 shutdown_connections 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- 172.21.15.16:0/4266478398 wait complete. 2024-04-26T22:22:11.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 Processor -- start 2024-04-26T22:22:11.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- start start 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f399406e450 0x7f39941436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 0x7f39941e42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39940b29b0 con 0x7f399414dac0 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f39940b2830 con 0x7f399413ef30 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3998a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f39940b34f0 con 0x7f399406e450 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42882/0 (socket says 172.21.15.16:42882) 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 -- 172.21.15.16:0/3114041249 learned_addr learned my addr 172.21.15.16:0/3114041249 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3991e00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f399406e450 0x7f39941436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3989400640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 0x7f39941e42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 -- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f399406e450 msgr2=0x7f39941436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f399406e450 0x7f39941436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 -- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 msgr2=0x7f39941e42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 0x7f39941e42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3992800640 1 -- 172.21.15.16:0/3114041249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3994144360 con 0x7f399414dac0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.130+0000 7f3989400640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 0x7f39941e42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f3992800640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f398c00b9a0 tx=0x7f398c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c019070 con 0x7f399414dac0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c00cbc0 con 0x7f399414dac0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c014440 con 0x7f399414dac0 2024-04-26T22:22:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994143190 con 0x7f399414dac0 2024-04-26T22:22:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399414f350 con 0x7f399414dac0 2024-04-26T22:22:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3994069530 con 0x7f399414dac0 2024-04-26T22:22:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f398c01c070 con 0x7f399414dac0 2024-04-26T22:22:11.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 0x7f397006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f398c086660 con 0x7f399414dac0 2024-04-26T22:22:11.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.134+0000 7f3991e00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 0x7f397006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.138+0000 7f3991e00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 0x7f397006a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39840ad000 tx=0x7f39840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.138+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f398c0565d0 con 0x7f399414dac0 2024-04-26T22:22:11.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.306+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3994143360 con 0x7f399414dac0 2024-04-26T22:22:11.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.306+0000 7f398aa00640 1 -- 172.21.15.16:0/3114041249 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16657 (secure 0 0 0) 0x7f398c05a8d0 con 0x7f399414dac0 2024-04-26T22:22:11.312 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:11.312 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:08.552305+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 msgr2=0x7f397006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 0x7f397006a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39840ad000 tx=0x7f39840a6000 comp rx=0 tx=0).stop 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 msgr2=0x7f399413d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f398c00b9a0 tx=0x7f398c00be60 comp rx=0 tx=0).stop 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 shutdown_connections 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f39700683b0 0x7f397006a870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399414dac0 0x7f399413d5e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f399413ef30 0x7f39941e42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 --2- 172.21.15.16:0/3114041249 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f399406e450 0x7f39941436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 >> 172.21.15.16:0/3114041249 conn(0x7f39940b6620 msgr2=0x7f39940b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:11.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 shutdown_connections 2024-04-26T22:22:11.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.310+0000 7f3998a00640 1 -- 172.21.15.16:0/3114041249 wait complete. 2024-04-26T22:22:11.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:22:11.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:11.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 Processor -- start 2024-04-26T22:22:11.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 -- start start 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 0x7f3ae8141c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ae8145590 0x7f3ae8142190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae80b3cd0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae80b1ef0 con 0x7f3ae8145590 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3aede00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae80b21d0 con 0x7f3ae80b3780 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae6a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ae80b28e0 0x7f3ae8144e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48070/0 (socket says 172.21.15.16:48070) 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae6a00640 1 -- 172.21.15.16:0/966572477 learned_addr learned my addr 172.21.15.16:0/966572477 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:11.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae7400640 1 --2- 172.21.15.16:0/966572477 >> v2:172.21.15.16:3300/0 conn(0x7f3ae8145590 0x7f3ae8142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae6000640 1 -- 172.21.15.16:0/966572477 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361276251 0 0) 0x7f3ae80b3cd0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae6000640 1 -- 172.21.15.16:0/966572477 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3acc003530 con 0x7f3ae80b28e0 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3adfe00640 1 --2- 172.21.15.16:0/966572477 >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 0x7f3ae8141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae7400640 1 -- 172.21.15.16:0/966572477 >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 msgr2=0x7f3ae8141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae7400640 1 --2- 172.21.15.16:0/966572477 >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 0x7f3ae8141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae7400640 1 -- 172.21.15.16:0/966572477 >> v1:172.21.15.16:6789/0 conn(0x7f3ae80b28e0 legacy=0x7f3ae8144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3ae7400640 1 -- 172.21.15.16:0/966572477 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae81426d0 con 0x7f3ae8145590 2024-04-26T22:22:11.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.470+0000 7f3adfe00640 1 --2- 172.21.15.16:0/966572477 >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 0x7f3ae8141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:11.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3ae7400640 1 --2- 172.21.15.16:0/966572477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae8145590 0x7f3ae8142190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80b76e0 tx=0x7f3ae001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d852785abde17a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3ae6000640 1 -- 172.21.15.16:0/966572477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00b2070 con 0x7f3ae8145590 2024-04-26T22:22:11.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3ae6000640 1 -- 172.21.15.16:0/966572477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae00a5760 con 0x7f3ae8145590 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3ae6000640 1 -- 172.21.15.16:0/966572477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00a5b10 con 0x7f3ae8145590 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 -- 172.21.15.16:0/966572477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae8145590 msgr2=0x7f3ae8142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 --2- 172.21.15.16:0/966572477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae8145590 0x7f3ae8142190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80b76e0 tx=0x7f3ae001c8a0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 -- 172.21.15.16:0/966572477 shutdown_connections 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 --2- 172.21.15.16:0/966572477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae8145590 0x7f3ae8142190 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 --2- 172.21.15.16:0/966572477 >> v2:172.21.15.195:3300/0 conn(0x7f3ae80b3780 0x7f3ae8141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 -- 172.21.15.16:0/966572477 >> 172.21.15.16:0/966572477 conn(0x7f3ae80b6620 msgr2=0x7f3ae80b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:11.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 -- 172.21.15.16:0/966572477 shutdown_connections 2024-04-26T22:22:11.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.474+0000 7f3aede00640 1 -- 172.21.15.16:0/966572477 wait complete. 2024-04-26T22:22:11.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 Processor -- start 2024-04-26T22:22:11.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- start start 2024-04-26T22:22:11.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ae80b3780 0x7f3ae813c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ae8145590 0x7f3ae813ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae8151af0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae80b0ce0 con 0x7f3ae8145590 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae8151c70 con 0x7f3ae80b3780 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42900/0 (socket says 172.21.15.16:42900) 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 -- 172.21.15.16:0/3477203570 learned_addr learned my addr 172.21.15.16:0/3477203570 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3adfe00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ae80b3780 0x7f3ae813c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae7400640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ae8145590 0x7f3ae813ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 -- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ae80b3780 msgr2=0x7f3ae813c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ae80b3780 0x7f3ae813c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 -- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ae8145590 msgr2=0x7f3ae813ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ae8145590 0x7f3ae813ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 -- 172.21.15.16:0/3477203570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae813daf0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3ae6a00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c450 tx=0x7f3ad800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8017070 con 0x7f3ae80b28e0 2024-04-26T22:22:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8005cf0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8007290 con 0x7f3ae80b28e0 2024-04-26T22:22:11.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae80aaea0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae813dd70 con 0x7f3ae80b28e0 2024-04-26T22:22:11.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.478+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae8069530 con 0x7f3ae80b28e0 2024-04-26T22:22:11.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.482+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3ad801a070 con 0x7f3ae80b28e0 2024-04-26T22:22:11.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.482+0000 7f3adf400640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 0x7f3ac406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.482+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3ad8085da0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.482+0000 7f3adfe00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 0x7f3ac406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.482+0000 7f3adfe00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 0x7f3ac406a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80b9980 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.486+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3ae813daf0 con 0x7f3ae80b28e0 2024-04-26T22:22:11.532 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-26T22:22:11.526+0000 7fe022800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:22:11.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.650+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ae80aabc0 con 0x7f3ac4068380 2024-04-26T22:22:11.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.658+0000 7f3adf400640 1 -- 172.21.15.16:0/3477203570 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f3ae80aabc0 con 0x7f3ac4068380 2024-04-26T22:22:11.664 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:11.665 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 msgr2=0x7f3ac406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 0x7f3ac406a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80b9980 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2024-04-26T22:22:11.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 msgr2=0x7f3ae813a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c450 tx=0x7f3ad800c910 comp rx=0 tx=0).stop 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 shutdown_connections 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3ac4068380 0x7f3ac406a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ae8145590 0x7f3ae813ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3ae80b3780 0x7f3ae813c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 --2- 172.21.15.16:0/3477203570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ae80b28e0 0x7f3ae813a2a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 >> 172.21.15.16:0/3477203570 conn(0x7f3ae80b6620 msgr2=0x7f3ae80b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 shutdown_connections 2024-04-26T22:22:11.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.662+0000 7f3aede00640 1 -- 172.21.15.16:0/3477203570 wait complete. 2024-04-26T22:22:11.684 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-26T22:22:10.111972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253256,"kb_used_data":3808,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721464,"statfs":{"total":773094113280,"available":772834779136,"internally_reserved":0,"allocated":3899392,"data_stored":2182652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.567455"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559744+0000","last_change":"2024-04-26T22:22:07.581325+0000","last_active":"2024-04-26T22:22:08.559744+0000","last_peered":"2024-04-26T22:22:08.559744+0000","last_clean":"2024-04-26T22:22:08.559744+0000","last_became_active":"2024-04-26T22:22:07.581060+0000","last_became_peered":"2024-04-26T22:22:07.581060+0000","last_unstale":"2024-04-26T22:22:08.559744+0000","last_undegraded":"2024-04-26T22:22:08.559744+0000","last_fullsized":"2024-04-26T22:22:08.559744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:17.524860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127780+0000","last_change":"2024-04-26T22:22:07.582609+0000","last_active":"2024-04-26T22:22:09.127780+0000","last_peered":"2024-04-26T22:22:09.127780+0000","last_clean":"2024-04-26T22:22:09.127780+0000","last_became_active":"2024-04-26T22:22:07.581185+0000","last_became_peered":"2024-04-26T22:22:07.581185+0000","last_unstale":"2024-04-26T22:22:09.127780+0000","last_undegraded":"2024-04-26T22:22:09.127780+0000","last_fullsized":"2024-04-26T22:22:09.127780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:18.064963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127362+0000","last_change":"2024-04-26T22:22:07.586535+0000","last_active":"2024-04-26T22:22:09.127362+0000","last_peered":"2024-04-26T22:22:09.127362+0000","last_clean":"2024-04-26T22:22:09.127362+0000","last_became_active":"2024-04-26T22:22:07.586319+0000","last_became_peered":"2024-04-26T22:22:07.586319+0000","last_unstale":"2024-04-26T22:22:09.127362+0000","last_undegraded":"2024-04-26T22:22:09.127362+0000","last_fullsized":"2024-04-26T22:22:09.127362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125950+0000","last_change":"2024-04-26T22:22:07.596196+0000","last_active":"2024-04-26T22:22:09.125950+0000","last_peered":"2024-04-26T22:22:09.125950+0000","last_clean":"2024-04-26T22:22:09.125950+0000","last_became_active":"2024-04-26T22:22:07.593918+0000","last_became_peered":"2024-04-26T22:22:07.593918+0000","last_unstale":"2024-04-26T22:22:09.125950+0000","last_undegraded":"2024-04-26T22:22:09.125950+0000","last_fullsized":"2024-04-26T22:22:09.125950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:13.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125986+0000","last_change":"2024-04-26T22:22:07.576884+0000","last_active":"2024-04-26T22:22:09.125986+0000","last_peered":"2024-04-26T22:22:09.125986+0000","last_clean":"2024-04-26T22:22:09.125986+0000","last_became_active":"2024-04-26T22:22:07.576585+0000","last_became_peered":"2024-04-26T22:22:07.576585+0000","last_unstale":"2024-04-26T22:22:09.125986+0000","last_undegraded":"2024-04-26T22:22:09.125986+0000","last_fullsized":"2024-04-26T22:22:09.125986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:01.485976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126487+0000","last_change":"2024-04-26T22:22:07.579200+0000","last_active":"2024-04-26T22:22:09.126487+0000","last_peered":"2024-04-26T22:22:09.126487+0000","last_clean":"2024-04-26T22:22:09.126487+0000","last_became_active":"2024-04-26T22:22:07.578668+0000","last_became_peered":"2024-04-26T22:22:07.578668+0000","last_unstale":"2024-04-26T22:22:09.126487+0000","last_undegraded":"2024-04-26T22:22:09.126487+0000","last_fullsized":"2024-04-26T22:22:09.126487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127368+0000","last_change":"2024-04-26T22:22:07.582092+0000","last_active":"2024-04-26T22:22:09.127368+0000","last_peered":"2024-04-26T22:22:09.127368+0000","last_clean":"2024-04-26T22:22:09.127368+0000","last_became_active":"2024-04-26T22:22:07.581824+0000","last_became_peered":"2024-04-26T22:22:07.581824+0000","last_unstale":"2024-04-26T22:22:09.127368+0000","last_undegraded":"2024-04-26T22:22:09.127368+0000","last_fullsized":"2024-04-26T22:22:09.127368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126856+0000","last_change":"2024-04-26T22:22:07.580997+0000","last_active":"2024-04-26T22:22:09.126856+0000","last_peered":"2024-04-26T22:22:09.126856+0000","last_clean":"2024-04-26T22:22:09.126856+0000","last_became_active":"2024-04-26T22:22:07.580698+0000","last_became_peered":"2024-04-26T22:22:07.580698+0000","last_unstale":"2024-04-26T22:22:09.126856+0000","last_undegraded":"2024-04-26T22:22:09.126856+0000","last_fullsized":"2024-04-26T22:22:09.126856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.561061+0000","last_change":"2024-04-26T22:22:07.594316+0000","last_active":"2024-04-26T22:22:08.561061+0000","last_peered":"2024-04-26T22:22:08.561061+0000","last_clean":"2024-04-26T22:22:08.561061+0000","last_became_active":"2024-04-26T22:22:07.593996+0000","last_became_peered":"2024-04-26T22:22:07.593996+0000","last_unstale":"2024-04-26T22:22:08.561061+0000","last_undegraded":"2024-04-26T22:22:08.561061+0000","last_fullsized":"2024-04-26T22:22:08.561061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127165+0000","last_change":"2024-04-26T22:22:07.596491+0000","last_active":"2024-04-26T22:22:09.127165+0000","last_peered":"2024-04-26T22:22:09.127165+0000","last_clean":"2024-04-26T22:22:09.127165+0000","last_became_active":"2024-04-26T22:22:07.596116+0000","last_became_peered":"2024-04-26T22:22:07.596116+0000","last_unstale":"2024-04-26T22:22:09.127165+0000","last_undegraded":"2024-04-26T22:22:09.127165+0000","last_fullsized":"2024-04-26T22:22:09.127165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127839+0000","last_change":"2024-04-26T22:22:07.594376+0000","last_active":"2024-04-26T22:22:09.127839+0000","last_peered":"2024-04-26T22:22:09.127839+0000","last_clean":"2024-04-26T22:22:09.127839+0000","last_became_active":"2024-04-26T22:22:07.594038+0000","last_became_peered":"2024-04-26T22:22:07.594038+0000","last_unstale":"2024-04-26T22:22:09.127839+0000","last_undegraded":"2024-04-26T22:22:09.127839+0000","last_fullsized":"2024-04-26T22:22:09.127839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:08.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127086+0000","last_change":"2024-04-26T22:22:07.578714+0000","last_active":"2024-04-26T22:22:09.127086+0000","last_peered":"2024-04-26T22:22:09.127086+0000","last_clean":"2024-04-26T22:22:09.127086+0000","last_became_active":"2024-04-26T22:22:07.578460+0000","last_became_peered":"2024-04-26T22:22:07.578460+0000","last_unstale":"2024-04-26T22:22:09.127086+0000","last_undegraded":"2024-04-26T22:22:09.127086+0000","last_fullsized":"2024-04-26T22:22:09.127086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126155+0000","last_change":"2024-04-26T22:22:07.585450+0000","last_active":"2024-04-26T22:22:09.126155+0000","last_peered":"2024-04-26T22:22:09.126155+0000","last_clean":"2024-04-26T22:22:09.126155+0000","last_became_active":"2024-04-26T22:22:07.584037+0000","last_became_peered":"2024-04-26T22:22:07.584037+0000","last_unstale":"2024-04-26T22:22:09.126155+0000","last_undegraded":"2024-04-26T22:22:09.126155+0000","last_fullsized":"2024-04-26T22:22:09.126155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:45.954494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126663+0000","last_change":"2024-04-26T22:22:07.578920+0000","last_active":"2024-04-26T22:22:09.126663+0000","last_peered":"2024-04-26T22:22:09.126663+0000","last_clean":"2024-04-26T22:22:09.126663+0000","last_became_active":"2024-04-26T22:22:07.578246+0000","last_became_peered":"2024-04-26T22:22:07.578246+0000","last_unstale":"2024-04-26T22:22:09.126663+0000","last_undegraded":"2024-04-26T22:22:09.126663+0000","last_fullsized":"2024-04-26T22:22:09.126663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126782+0000","last_change":"2024-04-26T22:22:07.571554+0000","last_active":"2024-04-26T22:22:09.126782+0000","last_peered":"2024-04-26T22:22:09.126782+0000","last_clean":"2024-04-26T22:22:09.126782+0000","last_became_active":"2024-04-26T22:22:07.571250+0000","last_became_peered":"2024-04-26T22:22:07.571250+0000","last_unstale":"2024-04-26T22:22:09.126782+0000","last_undegraded":"2024-04-26T22:22:09.126782+0000","last_fullsized":"2024-04-26T22:22:09.126782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127206+0000","last_change":"2024-04-26T22:22:07.584527+0000","last_active":"2024-04-26T22:22:09.127206+0000","last_peered":"2024-04-26T22:22:09.127206+0000","last_clean":"2024-04-26T22:22:09.127206+0000","last_became_active":"2024-04-26T22:22:07.584157+0000","last_became_peered":"2024-04-26T22:22:07.584157+0000","last_unstale":"2024-04-26T22:22:09.127206+0000","last_undegraded":"2024-04-26T22:22:09.127206+0000","last_fullsized":"2024-04-26T22:22:09.127206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127875+0000","last_change":"2024-04-26T22:22:07.585024+0000","last_active":"2024-04-26T22:22:09.127875+0000","last_peered":"2024-04-26T22:22:09.127875+0000","last_clean":"2024-04-26T22:22:09.127875+0000","last_became_active":"2024-04-26T22:22:07.582273+0000","last_became_peered":"2024-04-26T22:22:07.582273+0000","last_unstale":"2024-04-26T22:22:09.127875+0000","last_undegraded":"2024-04-26T22:22:09.127875+0000","last_fullsized":"2024-04-26T22:22:09.127875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:55:23.866287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127783+0000","last_change":"2024-04-26T22:22:07.594012+0000","last_active":"2024-04-26T22:22:09.127783+0000","last_peered":"2024-04-26T22:22:09.127783+0000","last_clean":"2024-04-26T22:22:09.127783+0000","last_became_active":"2024-04-26T22:22:07.593698+0000","last_became_peered":"2024-04-26T22:22:07.593698+0000","last_unstale":"2024-04-26T22:22:09.127783+0000","last_undegraded":"2024-04-26T22:22:09.127783+0000","last_fullsized":"2024-04-26T22:22:09.127783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:45.836913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127609+0000","last_change":"2024-04-26T22:22:07.593768+0000","last_active":"2024-04-26T22:22:09.127609+0000","last_peered":"2024-04-26T22:22:09.127609+0000","last_clean":"2024-04-26T22:22:09.127609+0000","last_became_active":"2024-04-26T22:22:07.593220+0000","last_became_peered":"2024-04-26T22:22:07.593220+0000","last_unstale":"2024-04-26T22:22:09.127609+0000","last_undegraded":"2024-04-26T22:22:09.127609+0000","last_fullsized":"2024-04-26T22:22:09.127609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126469+0000","last_change":"2024-04-26T22:22:07.577229+0000","last_active":"2024-04-26T22:22:09.126469+0000","last_peered":"2024-04-26T22:22:09.126469+0000","last_clean":"2024-04-26T22:22:09.126469+0000","last_became_active":"2024-04-26T22:22:07.576961+0000","last_became_peered":"2024-04-26T22:22:07.576961+0000","last_unstale":"2024-04-26T22:22:09.126469+0000","last_undegraded":"2024-04-26T22:22:09.126469+0000","last_fullsized":"2024-04-26T22:22:09.126469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:03.462107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560016+0000","last_change":"2024-04-26T22:22:07.580919+0000","last_active":"2024-04-26T22:22:08.560016+0000","last_peered":"2024-04-26T22:22:08.560016+0000","last_clean":"2024-04-26T22:22:08.560016+0000","last_became_active":"2024-04-26T22:22:07.579976+0000","last_became_peered":"2024-04-26T22:22:07.579976+0000","last_unstale":"2024-04-26T22:22:08.560016+0000","last_undegraded":"2024-04-26T22:22:08.560016+0000","last_fullsized":"2024-04-26T22:22:08.560016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:40.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560126+0000","last_change":"2024-04-26T22:22:07.577317+0000","last_active":"2024-04-26T22:22:08.560126+0000","last_peered":"2024-04-26T22:22:08.560126+0000","last_clean":"2024-04-26T22:22:08.560126+0000","last_became_active":"2024-04-26T22:22:07.577005+0000","last_became_peered":"2024-04-26T22:22:07.577005+0000","last_unstale":"2024-04-26T22:22:08.560126+0000","last_undegraded":"2024-04-26T22:22:08.560126+0000","last_fullsized":"2024-04-26T22:22:08.560126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:21.302988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.584092+0000","last_change":"2024-04-26T22:22:07.572227+0000","last_active":"2024-04-26T22:22:07.584092+0000","last_peered":"2024-04-26T22:22:07.584092+0000","last_clean":"2024-04-26T22:22:07.584092+0000","last_became_active":"2024-04-26T22:22:07.571960+0000","last_became_peered":"2024-04-26T22:22:07.571960+0000","last_unstale":"2024-04-26T22:22:07.584092+0000","last_undegraded":"2024-04-26T22:22:07.584092+0000","last_fullsized":"2024-04-26T22:22:07.584092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.644074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126803+0000","last_change":"2024-04-26T22:22:07.581544+0000","last_active":"2024-04-26T22:22:09.126803+0000","last_peered":"2024-04-26T22:22:09.126803+0000","last_clean":"2024-04-26T22:22:09.126803+0000","last_became_active":"2024-04-26T22:22:07.580606+0000","last_became_peered":"2024-04-26T22:22:07.580606+0000","last_unstale":"2024-04-26T22:22:09.126803+0000","last_undegraded":"2024-04-26T22:22:09.126803+0000","last_fullsized":"2024-04-26T22:22:09.126803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126774+0000","last_change":"2024-04-26T22:22:07.594173+0000","last_active":"2024-04-26T22:22:09.126774+0000","last_peered":"2024-04-26T22:22:09.126774+0000","last_clean":"2024-04-26T22:22:09.126774+0000","last_became_active":"2024-04-26T22:22:07.593038+0000","last_became_peered":"2024-04-26T22:22:07.593038+0000","last_unstale":"2024-04-26T22:22:09.126774+0000","last_undegraded":"2024-04-26T22:22:09.126774+0000","last_fullsized":"2024-04-26T22:22:09.126774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127892+0000","last_change":"2024-04-26T22:22:07.572467+0000","last_active":"2024-04-26T22:22:09.127892+0000","last_peered":"2024-04-26T22:22:09.127892+0000","last_clean":"2024-04-26T22:22:09.127892+0000","last_became_active":"2024-04-26T22:22:07.572229+0000","last_became_peered":"2024-04-26T22:22:07.572229+0000","last_unstale":"2024-04-26T22:22:09.127892+0000","last_undegraded":"2024-04-26T22:22:09.127892+0000","last_fullsized":"2024-04-26T22:22:09.127892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:39.051856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126706+0000","last_change":"2024-04-26T22:22:07.596132+0000","last_active":"2024-04-26T22:22:09.126706+0000","last_peered":"2024-04-26T22:22:09.126706+0000","last_clean":"2024-04-26T22:22:09.126706+0000","last_became_active":"2024-04-26T22:22:07.595185+0000","last_became_peered":"2024-04-26T22:22:07.595185+0000","last_unstale":"2024-04-26T22:22:09.126706+0000","last_undegraded":"2024-04-26T22:22:09.126706+0000","last_fullsized":"2024-04-26T22:22:09.126706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127287+0000","last_change":"2024-04-26T22:22:07.573971+0000","last_active":"2024-04-26T22:22:09.127287+0000","last_peered":"2024-04-26T22:22:09.127287+0000","last_clean":"2024-04-26T22:22:09.127287+0000","last_became_active":"2024-04-26T22:22:07.573407+0000","last_became_peered":"2024-04-26T22:22:07.573407+0000","last_unstale":"2024-04-26T22:22:09.127287+0000","last_undegraded":"2024-04-26T22:22:09.127287+0000","last_fullsized":"2024-04-26T22:22:09.127287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560135+0000","last_change":"2024-04-26T22:22:07.575623+0000","last_active":"2024-04-26T22:22:08.560135+0000","last_peered":"2024-04-26T22:22:08.560135+0000","last_clean":"2024-04-26T22:22:08.560135+0000","last_became_active":"2024-04-26T22:22:07.575315+0000","last_became_peered":"2024-04-26T22:22:07.575315+0000","last_unstale":"2024-04-26T22:22:08.560135+0000","last_undegraded":"2024-04-26T22:22:08.560135+0000","last_fullsized":"2024-04-26T22:22:08.560135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:03.776408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127560+0000","last_change":"2024-04-26T22:22:07.578323+0000","last_active":"2024-04-26T22:22:09.127560+0000","last_peered":"2024-04-26T22:22:09.127560+0000","last_clean":"2024-04-26T22:22:09.127560+0000","last_became_active":"2024-04-26T22:22:07.577825+0000","last_became_peered":"2024-04-26T22:22:07.577825+0000","last_unstale":"2024-04-26T22:22:09.127560+0000","last_undegraded":"2024-04-26T22:22:09.127560+0000","last_fullsized":"2024-04-26T22:22:09.127560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559385+0000","last_change":"2024-04-26T22:22:07.581687+0000","last_active":"2024-04-26T22:22:08.559385+0000","last_peered":"2024-04-26T22:22:08.559385+0000","last_clean":"2024-04-26T22:22:08.559385+0000","last_became_active":"2024-04-26T22:22:07.581420+0000","last_became_peered":"2024-04-26T22:22:07.581420+0000","last_unstale":"2024-04-26T22:22:08.559385+0000","last_undegraded":"2024-04-26T22:22:08.559385+0000","last_fullsized":"2024-04-26T22:22:08.559385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:33.742176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126917+0000","last_change":"2024-04-26T22:22:07.588577+0000","last_active":"2024-04-26T22:22:09.126917+0000","last_peered":"2024-04-26T22:22:09.126917+0000","last_clean":"2024-04-26T22:22:09.126917+0000","last_became_active":"2024-04-26T22:22:07.587907+0000","last_became_peered":"2024-04-26T22:22:07.587907+0000","last_unstale":"2024-04-26T22:22:09.126917+0000","last_undegraded":"2024-04-26T22:22:09.126917+0000","last_fullsized":"2024-04-26T22:22:09.126917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.582992+0000","last_change":"2024-04-26T22:22:07.576656+0000","last_active":"2024-04-26T22:22:07.582992+0000","last_peered":"2024-04-26T22:22:07.582992+0000","last_clean":"2024-04-26T22:22:07.582992+0000","last_became_active":"2024-04-26T22:22:07.576401+0000","last_became_peered":"2024-04-26T22:22:07.576401+0000","last_unstale":"2024-04-26T22:22:07.582992+0000","last_undegraded":"2024-04-26T22:22:07.582992+0000","last_fullsized":"2024-04-26T22:22:07.582992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.772217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559834+0000","last_change":"2024-04-26T22:22:06.574181+0000","last_active":"2024-04-26T22:22:08.559834+0000","last_peered":"2024-04-26T22:22:08.559834+0000","last_clean":"2024-04-26T22:22:08.559834+0000","last_became_active":"2024-04-26T22:22:06.573553+0000","last_became_peered":"2024-04-26T22:22:06.573553+0000","last_unstale":"2024-04-26T22:22:08.559834+0000","last_undegraded":"2024-04-26T22:22:08.559834+0000","last_fullsized":"2024-04-26T22:22:08.559834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.454162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559735+0000","last_change":"2024-04-26T22:22:07.562642+0000","last_active":"2024-04-26T22:22:08.559735+0000","last_peered":"2024-04-26T22:22:08.559735+0000","last_clean":"2024-04-26T22:22:08.559735+0000","last_became_active":"2024-04-26T22:22:07.562363+0000","last_became_peered":"2024-04-26T22:22:07.562363+0000","last_unstale":"2024-04-26T22:22:08.559735+0000","last_undegraded":"2024-04-26T22:22:08.559735+0000","last_fullsized":"2024-04-26T22:22:08.559735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:57.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.599518+0000","last_change":"2024-04-26T22:22:06.576372+0000","last_active":"2024-04-26T22:22:07.599518+0000","last_peered":"2024-04-26T22:22:07.599518+0000","last_clean":"2024-04-26T22:22:07.599518+0000","last_became_active":"2024-04-26T22:22:06.576044+0000","last_became_peered":"2024-04-26T22:22:06.576044+0000","last_unstale":"2024-04-26T22:22:07.599518+0000","last_undegraded":"2024-04-26T22:22:07.599518+0000","last_fullsized":"2024-04-26T22:22:07.599518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:44.911556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560842+0000","last_change":"2024-04-26T22:22:07.579820+0000","last_active":"2024-04-26T22:22:08.560842+0000","last_peered":"2024-04-26T22:22:08.560842+0000","last_clean":"2024-04-26T22:22:08.560842+0000","last_became_active":"2024-04-26T22:22:07.579492+0000","last_became_peered":"2024-04-26T22:22:07.579492+0000","last_unstale":"2024-04-26T22:22:08.560842+0000","last_undegraded":"2024-04-26T22:22:08.560842+0000","last_fullsized":"2024-04-26T22:22:08.560842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127687+0000","last_change":"2024-04-26T22:22:06.581120+0000","last_active":"2024-04-26T22:22:09.127687+0000","last_peered":"2024-04-26T22:22:09.127687+0000","last_clean":"2024-04-26T22:22:09.127687+0000","last_became_active":"2024-04-26T22:22:06.580824+0000","last_became_peered":"2024-04-26T22:22:06.580824+0000","last_unstale":"2024-04-26T22:22:09.127687+0000","last_undegraded":"2024-04-26T22:22:09.127687+0000","last_fullsized":"2024-04-26T22:22:09.127687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:25.491791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126786+0000","last_change":"2024-04-26T22:22:07.597419+0000","last_active":"2024-04-26T22:22:09.126786+0000","last_peered":"2024-04-26T22:22:09.126786+0000","last_clean":"2024-04-26T22:22:09.126786+0000","last_became_active":"2024-04-26T22:22:07.595793+0000","last_became_peered":"2024-04-26T22:22:07.595793+0000","last_unstale":"2024-04-26T22:22:09.126786+0000","last_undegraded":"2024-04-26T22:22:09.126786+0000","last_fullsized":"2024-04-26T22:22:09.126786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126571+0000","last_change":"2024-04-26T22:22:06.581689+0000","last_active":"2024-04-26T22:22:09.126571+0000","last_peered":"2024-04-26T22:22:09.126571+0000","last_clean":"2024-04-26T22:22:09.126571+0000","last_became_active":"2024-04-26T22:22:06.581386+0000","last_became_peered":"2024-04-26T22:22:06.581386+0000","last_unstale":"2024-04-26T22:22:09.126571+0000","last_undegraded":"2024-04-26T22:22:09.126571+0000","last_fullsized":"2024-04-26T22:22:09.126571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.512350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127614+0000","last_change":"2024-04-26T22:22:07.583700+0000","last_active":"2024-04-26T22:22:09.127614+0000","last_peered":"2024-04-26T22:22:09.127614+0000","last_clean":"2024-04-26T22:22:09.127614+0000","last_became_active":"2024-04-26T22:22:07.583408+0000","last_became_peered":"2024-04-26T22:22:07.583408+0000","last_unstale":"2024-04-26T22:22:09.127614+0000","last_undegraded":"2024-04-26T22:22:09.127614+0000","last_fullsized":"2024-04-26T22:22:09.127614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560628+0000","last_change":"2024-04-26T22:22:06.570478+0000","last_active":"2024-04-26T22:22:08.560628+0000","last_peered":"2024-04-26T22:22:08.560628+0000","last_clean":"2024-04-26T22:22:08.560628+0000","last_became_active":"2024-04-26T22:22:06.570098+0000","last_became_peered":"2024-04-26T22:22:06.570098+0000","last_unstale":"2024-04-26T22:22:08.560628+0000","last_undegraded":"2024-04-26T22:22:08.560628+0000","last_fullsized":"2024-04-26T22:22:08.560628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:44.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127086+0000","last_change":"2024-04-26T22:22:07.577347+0000","last_active":"2024-04-26T22:22:09.127086+0000","last_peered":"2024-04-26T22:22:09.127086+0000","last_clean":"2024-04-26T22:22:09.127086+0000","last_became_active":"2024-04-26T22:22:07.577066+0000","last_became_peered":"2024-04-26T22:22:07.577066+0000","last_unstale":"2024-04-26T22:22:09.127086+0000","last_undegraded":"2024-04-26T22:22:09.127086+0000","last_fullsized":"2024-04-26T22:22:09.127086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560186+0000","last_change":"2024-04-26T22:22:06.564639+0000","last_active":"2024-04-26T22:22:08.560186+0000","last_peered":"2024-04-26T22:22:08.560186+0000","last_clean":"2024-04-26T22:22:08.560186+0000","last_became_active":"2024-04-26T22:22:06.564345+0000","last_became_peered":"2024-04-26T22:22:06.564345+0000","last_unstale":"2024-04-26T22:22:08.560186+0000","last_undegraded":"2024-04-26T22:22:08.560186+0000","last_fullsized":"2024-04-26T22:22:08.560186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:20.721292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559159+0000","last_change":"2024-04-26T22:22:07.565460+0000","last_active":"2024-04-26T22:22:08.559159+0000","last_peered":"2024-04-26T22:22:08.559159+0000","last_clean":"2024-04-26T22:22:08.559159+0000","last_became_active":"2024-04-26T22:22:07.565145+0000","last_became_peered":"2024-04-26T22:22:07.565145+0000","last_unstale":"2024-04-26T22:22:08.559159+0000","last_undegraded":"2024-04-26T22:22:08.559159+0000","last_fullsized":"2024-04-26T22:22:08.559159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:17.524860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126816+0000","last_change":"2024-04-26T22:22:06.568721+0000","last_active":"2024-04-26T22:22:09.126816+0000","last_peered":"2024-04-26T22:22:09.126816+0000","last_clean":"2024-04-26T22:22:09.126816+0000","last_became_active":"2024-04-26T22:22:06.568450+0000","last_became_peered":"2024-04-26T22:22:06.568450+0000","last_unstale":"2024-04-26T22:22:09.126816+0000","last_undegraded":"2024-04-26T22:22:09.126816+0000","last_fullsized":"2024-04-26T22:22:09.126816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:02.943465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126071+0000","last_change":"2024-04-26T22:22:07.585687+0000","last_active":"2024-04-26T22:22:09.126071+0000","last_peered":"2024-04-26T22:22:09.126071+0000","last_clean":"2024-04-26T22:22:09.126071+0000","last_became_active":"2024-04-26T22:22:07.585426+0000","last_became_peered":"2024-04-26T22:22:07.585426+0000","last_unstale":"2024-04-26T22:22:09.126071+0000","last_undegraded":"2024-04-26T22:22:09.126071+0000","last_fullsized":"2024-04-26T22:22:09.126071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559211+0000","last_change":"2024-04-26T22:22:06.560748+0000","last_active":"2024-04-26T22:22:08.559211+0000","last_peered":"2024-04-26T22:22:08.559211+0000","last_clean":"2024-04-26T22:22:08.559211+0000","last_became_active":"2024-04-26T22:22:06.560438+0000","last_became_peered":"2024-04-26T22:22:06.560438+0000","last_unstale":"2024-04-26T22:22:08.559211+0000","last_undegraded":"2024-04-26T22:22:08.559211+0000","last_fullsized":"2024-04-26T22:22:08.559211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:09.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127766+0000","last_change":"2024-04-26T22:22:07.578851+0000","last_active":"2024-04-26T22:22:09.127766+0000","last_peered":"2024-04-26T22:22:09.127766+0000","last_clean":"2024-04-26T22:22:09.127766+0000","last_became_active":"2024-04-26T22:22:07.578597+0000","last_became_peered":"2024-04-26T22:22:07.578597+0000","last_unstale":"2024-04-26T22:22:09.127766+0000","last_undegraded":"2024-04-26T22:22:09.127766+0000","last_fullsized":"2024-04-26T22:22:09.127766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127768+0000","last_change":"2024-04-26T22:22:06.575175+0000","last_active":"2024-04-26T22:22:09.127768+0000","last_peered":"2024-04-26T22:22:09.127768+0000","last_clean":"2024-04-26T22:22:09.127768+0000","last_became_active":"2024-04-26T22:22:06.574799+0000","last_became_peered":"2024-04-26T22:22:06.574799+0000","last_unstale":"2024-04-26T22:22:09.127768+0000","last_undegraded":"2024-04-26T22:22:09.127768+0000","last_fullsized":"2024-04-26T22:22:09.127768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:16.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127763+0000","last_change":"2024-04-26T22:22:07.593853+0000","last_active":"2024-04-26T22:22:09.127763+0000","last_peered":"2024-04-26T22:22:09.127763+0000","last_clean":"2024-04-26T22:22:09.127763+0000","last_became_active":"2024-04-26T22:22:07.593459+0000","last_became_peered":"2024-04-26T22:22:07.593459+0000","last_unstale":"2024-04-26T22:22:09.127763+0000","last_undegraded":"2024-04-26T22:22:09.127763+0000","last_fullsized":"2024-04-26T22:22:09.127763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:55:23.866287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562504+0000","last_change":"2024-04-26T22:22:06.562972+0000","last_active":"2024-04-26T22:22:07.562504+0000","last_peered":"2024-04-26T22:22:07.562504+0000","last_clean":"2024-04-26T22:22:07.562504+0000","last_became_active":"2024-04-26T22:22:06.562678+0000","last_became_peered":"2024-04-26T22:22:06.562678+0000","last_unstale":"2024-04-26T22:22:07.562504+0000","last_undegraded":"2024-04-26T22:22:07.562504+0000","last_fullsized":"2024-04-26T22:22:07.562504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:12.384980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127696+0000","last_change":"2024-04-26T22:22:07.574354+0000","last_active":"2024-04-26T22:22:09.127696+0000","last_peered":"2024-04-26T22:22:09.127696+0000","last_clean":"2024-04-26T22:22:09.127696+0000","last_became_active":"2024-04-26T22:22:07.574029+0000","last_became_peered":"2024-04-26T22:22:07.574029+0000","last_unstale":"2024-04-26T22:22:09.127696+0000","last_undegraded":"2024-04-26T22:22:09.127696+0000","last_fullsized":"2024-04-26T22:22:09.127696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:08.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127400+0000","last_change":"2024-04-26T22:22:06.574798+0000","last_active":"2024-04-26T22:22:09.127400+0000","last_peered":"2024-04-26T22:22:09.127400+0000","last_clean":"2024-04-26T22:22:09.127400+0000","last_became_active":"2024-04-26T22:22:06.574302+0000","last_became_peered":"2024-04-26T22:22:06.574302+0000","last_unstale":"2024-04-26T22:22:09.127400+0000","last_undegraded":"2024-04-26T22:22:09.127400+0000","last_fullsized":"2024-04-26T22:22:09.127400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127313+0000","last_change":"2024-04-26T22:22:07.586831+0000","last_active":"2024-04-26T22:22:09.127313+0000","last_peered":"2024-04-26T22:22:09.127313+0000","last_clean":"2024-04-26T22:22:09.127313+0000","last_became_active":"2024-04-26T22:22:07.585557+0000","last_became_peered":"2024-04-26T22:22:07.585557+0000","last_unstale":"2024-04-26T22:22:09.127313+0000","last_undegraded":"2024-04-26T22:22:09.127313+0000","last_fullsized":"2024-04-26T22:22:09.127313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127636+0000","last_change":"2024-04-26T22:22:06.580344+0000","last_active":"2024-04-26T22:22:09.127636+0000","last_peered":"2024-04-26T22:22:09.127636+0000","last_clean":"2024-04-26T22:22:09.127636+0000","last_became_active":"2024-04-26T22:22:06.580102+0000","last_became_peered":"2024-04-26T22:22:06.580102+0000","last_unstale":"2024-04-26T22:22:09.127636+0000","last_undegraded":"2024-04-26T22:22:09.127636+0000","last_fullsized":"2024-04-26T22:22:09.127636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:56.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125780+0000","last_change":"2024-04-26T22:22:07.580027+0000","last_active":"2024-04-26T22:22:09.125780+0000","last_peered":"2024-04-26T22:22:09.125780+0000","last_clean":"2024-04-26T22:22:09.125780+0000","last_became_active":"2024-04-26T22:22:07.578401+0000","last_became_peered":"2024-04-26T22:22:07.578401+0000","last_unstale":"2024-04-26T22:22:09.125780+0000","last_undegraded":"2024-04-26T22:22:09.125780+0000","last_fullsized":"2024-04-26T22:22:09.125780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:03.776408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560637+0000","last_change":"2024-04-26T22:22:06.560985+0000","last_active":"2024-04-26T22:22:08.560637+0000","last_peered":"2024-04-26T22:22:08.560637+0000","last_clean":"2024-04-26T22:22:08.560637+0000","last_became_active":"2024-04-26T22:22:06.560481+0000","last_became_peered":"2024-04-26T22:22:06.560481+0000","last_unstale":"2024-04-26T22:22:08.560637+0000","last_undegraded":"2024-04-26T22:22:08.560637+0000","last_fullsized":"2024-04-26T22:22:08.560637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.454162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127419+0000","last_change":"2024-04-26T22:22:07.583042+0000","last_active":"2024-04-26T22:22:09.127419+0000","last_peered":"2024-04-26T22:22:09.127419+0000","last_clean":"2024-04-26T22:22:09.127419+0000","last_became_active":"2024-04-26T22:22:07.581160+0000","last_became_peered":"2024-04-26T22:22:07.581160+0000","last_unstale":"2024-04-26T22:22:09.127419+0000","last_undegraded":"2024-04-26T22:22:09.127419+0000","last_fullsized":"2024-04-26T22:22:09.127419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125967+0000","last_change":"2024-04-26T22:22:06.575284+0000","last_active":"2024-04-26T22:22:09.125967+0000","last_peered":"2024-04-26T22:22:09.125967+0000","last_clean":"2024-04-26T22:22:09.125967+0000","last_became_active":"2024-04-26T22:22:06.574988+0000","last_became_peered":"2024-04-26T22:22:06.574988+0000","last_unstale":"2024-04-26T22:22:09.125967+0000","last_undegraded":"2024-04-26T22:22:09.125967+0000","last_fullsized":"2024-04-26T22:22:09.125967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:57:49.587337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127167+0000","last_change":"2024-04-26T22:22:07.588806+0000","last_active":"2024-04-26T22:22:09.127167+0000","last_peered":"2024-04-26T22:22:09.127167+0000","last_clean":"2024-04-26T22:22:09.127167+0000","last_became_active":"2024-04-26T22:22:07.588410+0000","last_became_peered":"2024-04-26T22:22:07.588410+0000","last_unstale":"2024-04-26T22:22:09.127167+0000","last_undegraded":"2024-04-26T22:22:09.127167+0000","last_fullsized":"2024-04-26T22:22:09.127167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126772+0000","last_change":"2024-04-26T22:22:06.574821+0000","last_active":"2024-04-26T22:22:09.126772+0000","last_peered":"2024-04-26T22:22:09.126772+0000","last_clean":"2024-04-26T22:22:09.126772+0000","last_became_active":"2024-04-26T22:22:06.574550+0000","last_became_peered":"2024-04-26T22:22:06.574550+0000","last_unstale":"2024-04-26T22:22:09.126772+0000","last_undegraded":"2024-04-26T22:22:09.126772+0000","last_fullsized":"2024-04-26T22:22:09.126772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559526+0000","last_change":"2024-04-26T22:22:07.562266+0000","last_active":"2024-04-26T22:22:08.559526+0000","last_peered":"2024-04-26T22:22:08.559526+0000","last_clean":"2024-04-26T22:22:08.559526+0000","last_became_active":"2024-04-26T22:22:07.561862+0000","last_became_peered":"2024-04-26T22:22:07.561862+0000","last_unstale":"2024-04-26T22:22:08.559526+0000","last_undegraded":"2024-04-26T22:22:08.559526+0000","last_fullsized":"2024-04-26T22:22:08.559526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:26.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126659+0000","last_change":"2024-04-26T22:22:06.573021+0000","last_active":"2024-04-26T22:22:09.126659+0000","last_peered":"2024-04-26T22:22:09.126659+0000","last_clean":"2024-04-26T22:22:09.126659+0000","last_became_active":"2024-04-26T22:22:06.572674+0000","last_became_peered":"2024-04-26T22:22:06.572674+0000","last_unstale":"2024-04-26T22:22:09.126659+0000","last_undegraded":"2024-04-26T22:22:09.126659+0000","last_fullsized":"2024-04-26T22:22:09.126659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:07.560206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560830+0000","last_change":"2024-04-26T22:22:07.573094+0000","last_active":"2024-04-26T22:22:08.560830+0000","last_peered":"2024-04-26T22:22:08.560830+0000","last_clean":"2024-04-26T22:22:08.560830+0000","last_became_active":"2024-04-26T22:22:07.572833+0000","last_became_peered":"2024-04-26T22:22:07.572833+0000","last_unstale":"2024-04-26T22:22:08.560830+0000","last_undegraded":"2024-04-26T22:22:08.560830+0000","last_fullsized":"2024-04-26T22:22:08.560830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:13.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126972+0000","last_change":"2024-04-26T22:22:06.578545+0000","last_active":"2024-04-26T22:22:09.126972+0000","last_peered":"2024-04-26T22:22:09.126972+0000","last_clean":"2024-04-26T22:22:09.126972+0000","last_became_active":"2024-04-26T22:22:06.577596+0000","last_became_peered":"2024-04-26T22:22:06.577596+0000","last_unstale":"2024-04-26T22:22:09.126972+0000","last_undegraded":"2024-04-26T22:22:09.126972+0000","last_fullsized":"2024-04-26T22:22:09.126972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:32.734230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127890+0000","last_change":"2024-04-26T22:22:07.572768+0000","last_active":"2024-04-26T22:22:09.127890+0000","last_peered":"2024-04-26T22:22:09.127890+0000","last_clean":"2024-04-26T22:22:09.127890+0000","last_became_active":"2024-04-26T22:22:07.572417+0000","last_became_peered":"2024-04-26T22:22:07.572417+0000","last_unstale":"2024-04-26T22:22:09.127890+0000","last_undegraded":"2024-04-26T22:22:09.127890+0000","last_fullsized":"2024-04-26T22:22:09.127890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560946+0000","last_change":"2024-04-26T22:22:06.563144+0000","last_active":"2024-04-26T22:22:08.560946+0000","last_peered":"2024-04-26T22:22:08.560946+0000","last_clean":"2024-04-26T22:22:08.560946+0000","last_became_active":"2024-04-26T22:22:06.562869+0000","last_became_peered":"2024-04-26T22:22:06.562869+0000","last_unstale":"2024-04-26T22:22:08.560946+0000","last_undegraded":"2024-04-26T22:22:08.560946+0000","last_fullsized":"2024-04-26T22:22:08.560946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:01.478581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126127+0000","last_change":"2024-04-26T22:22:07.594278+0000","last_active":"2024-04-26T22:22:09.126127+0000","last_peered":"2024-04-26T22:22:09.126127+0000","last_clean":"2024-04-26T22:22:09.126127+0000","last_became_active":"2024-04-26T22:22:07.593507+0000","last_became_peered":"2024-04-26T22:22:07.593507+0000","last_unstale":"2024-04-26T22:22:09.126127+0000","last_undegraded":"2024-04-26T22:22:09.126127+0000","last_fullsized":"2024-04-26T22:22:09.126127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560850+0000","last_change":"2024-04-26T22:22:06.573022+0000","last_active":"2024-04-26T22:22:08.560850+0000","last_peered":"2024-04-26T22:22:08.560850+0000","last_clean":"2024-04-26T22:22:08.560850+0000","last_became_active":"2024-04-26T22:22:06.568895+0000","last_became_peered":"2024-04-26T22:22:06.568895+0000","last_unstale":"2024-04-26T22:22:08.560850+0000","last_undegraded":"2024-04-26T22:22:08.560850+0000","last_fullsized":"2024-04-26T22:22:08.560850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:55.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126350+0000","last_change":"2024-04-26T22:22:07.581357+0000","last_active":"2024-04-26T22:22:09.126350+0000","last_peered":"2024-04-26T22:22:09.126350+0000","last_clean":"2024-04-26T22:22:09.126350+0000","last_became_active":"2024-04-26T22:22:07.581097+0000","last_became_peered":"2024-04-26T22:22:07.581097+0000","last_unstale":"2024-04-26T22:22:09.126350+0000","last_undegraded":"2024-04-26T22:22:09.126350+0000","last_fullsized":"2024-04-26T22:22:09.126350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:15.906434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560804+0000","last_change":"2024-04-26T22:22:06.570535+0000","last_active":"2024-04-26T22:22:08.560804+0000","last_peered":"2024-04-26T22:22:08.560804+0000","last_clean":"2024-04-26T22:22:08.560804+0000","last_became_active":"2024-04-26T22:22:06.570181+0000","last_became_peered":"2024-04-26T22:22:06.570181+0000","last_unstale":"2024-04-26T22:22:08.560804+0000","last_undegraded":"2024-04-26T22:22:08.560804+0000","last_fullsized":"2024-04-26T22:22:08.560804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:14.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126250+0000","last_change":"2024-04-26T22:22:07.564835+0000","last_active":"2024-04-26T22:22:09.126250+0000","last_peered":"2024-04-26T22:22:09.126250+0000","last_clean":"2024-04-26T22:22:09.126250+0000","last_became_active":"2024-04-26T22:22:07.561982+0000","last_became_peered":"2024-04-26T22:22:07.561982+0000","last_unstale":"2024-04-26T22:22:09.126250+0000","last_undegraded":"2024-04-26T22:22:09.126250+0000","last_fullsized":"2024-04-26T22:22:09.126250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:02.486527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.602674+0000","last_change":"2024-04-26T22:22:06.582173+0000","last_active":"2024-04-26T22:22:07.602674+0000","last_peered":"2024-04-26T22:22:07.602674+0000","last_clean":"2024-04-26T22:22:07.602674+0000","last_became_active":"2024-04-26T22:22:06.581678+0000","last_became_peered":"2024-04-26T22:22:06.581678+0000","last_unstale":"2024-04-26T22:22:07.602674+0000","last_undegraded":"2024-04-26T22:22:07.602674+0000","last_fullsized":"2024-04-26T22:22:07.602674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:30.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127179+0000","last_change":"2024-04-26T22:22:07.580016+0000","last_active":"2024-04-26T22:22:09.127179+0000","last_peered":"2024-04-26T22:22:09.127179+0000","last_clean":"2024-04-26T22:22:09.127179+0000","last_became_active":"2024-04-26T22:22:07.579705+0000","last_became_peered":"2024-04-26T22:22:07.579705+0000","last_unstale":"2024-04-26T22:22:09.127179+0000","last_undegraded":"2024-04-26T22:22:09.127179+0000","last_fullsized":"2024-04-26T22:22:09.127179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:41.173346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559857+0000","last_change":"2024-04-26T22:22:06.580423+0000","last_active":"2024-04-26T22:22:08.559857+0000","last_peered":"2024-04-26T22:22:08.559857+0000","last_clean":"2024-04-26T22:22:08.559857+0000","last_became_active":"2024-04-26T22:22:06.579838+0000","last_became_peered":"2024-04-26T22:22:06.579838+0000","last_unstale":"2024-04-26T22:22:08.559857+0000","last_undegraded":"2024-04-26T22:22:08.559857+0000","last_fullsized":"2024-04-26T22:22:08.559857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:20.721292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126088+0000","last_change":"2024-04-26T22:22:07.573636+0000","last_active":"2024-04-26T22:22:09.126088+0000","last_peered":"2024-04-26T22:22:09.126088+0000","last_clean":"2024-04-26T22:22:09.126088+0000","last_became_active":"2024-04-26T22:22:07.572556+0000","last_became_peered":"2024-04-26T22:22:07.572556+0000","last_unstale":"2024-04-26T22:22:09.126088+0000","last_undegraded":"2024-04-26T22:22:09.126088+0000","last_fullsized":"2024-04-26T22:22:09.126088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:15.590780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559744+0000","last_change":"2024-04-26T22:22:06.580094+0000","last_active":"2024-04-26T22:22:08.559744+0000","last_peered":"2024-04-26T22:22:08.559744+0000","last_clean":"2024-04-26T22:22:08.559744+0000","last_became_active":"2024-04-26T22:22:06.579628+0000","last_became_peered":"2024-04-26T22:22:06.579628+0000","last_unstale":"2024-04-26T22:22:08.559744+0000","last_undegraded":"2024-04-26T22:22:08.559744+0000","last_fullsized":"2024-04-26T22:22:08.559744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:14.898488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127362+0000","last_change":"2024-04-26T22:22:07.586265+0000","last_active":"2024-04-26T22:22:09.127362+0000","last_peered":"2024-04-26T22:22:09.127362+0000","last_clean":"2024-04-26T22:22:09.127362+0000","last_became_active":"2024-04-26T22:22:07.583555+0000","last_became_peered":"2024-04-26T22:22:07.583555+0000","last_unstale":"2024-04-26T22:22:09.127362+0000","last_undegraded":"2024-04-26T22:22:09.127362+0000","last_fullsized":"2024-04-26T22:22:09.127362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126703+0000","last_change":"2024-04-26T22:22:06.575950+0000","last_active":"2024-04-26T22:22:09.126703+0000","last_peered":"2024-04-26T22:22:09.126703+0000","last_clean":"2024-04-26T22:22:09.126703+0000","last_became_active":"2024-04-26T22:22:06.575699+0000","last_became_peered":"2024-04-26T22:22:06.575699+0000","last_unstale":"2024-04-26T22:22:09.126703+0000","last_undegraded":"2024-04-26T22:22:09.126703+0000","last_fullsized":"2024-04-26T22:22:09.126703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:57:49.587337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126370+0000","last_change":"2024-04-26T22:22:07.581695+0000","last_active":"2024-04-26T22:22:09.126370+0000","last_peered":"2024-04-26T22:22:09.126370+0000","last_clean":"2024-04-26T22:22:09.126370+0000","last_became_active":"2024-04-26T22:22:07.580477+0000","last_became_peered":"2024-04-26T22:22:07.580477+0000","last_unstale":"2024-04-26T22:22:09.126370+0000","last_undegraded":"2024-04-26T22:22:09.126370+0000","last_fullsized":"2024-04-26T22:22:09.126370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:21.729238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127094+0000","last_change":"2024-04-26T22:22:06.584443+0000","last_active":"2024-04-26T22:22:09.127094+0000","last_peered":"2024-04-26T22:22:09.127094+0000","last_clean":"2024-04-26T22:22:09.127094+0000","last_became_active":"2024-04-26T22:22:06.580948+0000","last_became_peered":"2024-04-26T22:22:06.580948+0000","last_unstale":"2024-04-26T22:22:09.127094+0000","last_undegraded":"2024-04-26T22:22:09.127094+0000","last_fullsized":"2024-04-26T22:22:09.127094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:07.560206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.128059+0000","last_change":"2024-04-26T22:22:07.592297+0000","last_active":"2024-04-26T22:22:09.128059+0000","last_peered":"2024-04-26T22:22:09.128059+0000","last_clean":"2024-04-26T22:22:09.128059+0000","last_became_active":"2024-04-26T22:22:07.592031+0000","last_became_peered":"2024-04-26T22:22:07.592031+0000","last_unstale":"2024-04-26T22:22:09.128059+0000","last_undegraded":"2024-04-26T22:22:09.128059+0000","last_fullsized":"2024-04-26T22:22:09.128059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562347+0000","last_change":"2024-04-26T22:22:06.580372+0000","last_active":"2024-04-26T22:22:07.562347+0000","last_peered":"2024-04-26T22:22:07.562347+0000","last_clean":"2024-04-26T22:22:07.562347+0000","last_became_active":"2024-04-26T22:22:06.580095+0000","last_became_peered":"2024-04-26T22:22:06.580095+0000","last_unstale":"2024-04-26T22:22:07.562347+0000","last_undegraded":"2024-04-26T22:22:07.562347+0000","last_fullsized":"2024-04-26T22:22:07.562347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:47.956280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.589058+0000","last_change":"2024-04-26T22:22:07.578669+0000","last_active":"2024-04-26T22:22:07.589058+0000","last_peered":"2024-04-26T22:22:07.589058+0000","last_clean":"2024-04-26T22:22:07.589058+0000","last_became_active":"2024-04-26T22:22:07.578369+0000","last_became_peered":"2024-04-26T22:22:07.578369+0000","last_unstale":"2024-04-26T22:22:07.589058+0000","last_undegraded":"2024-04-26T22:22:07.589058+0000","last_fullsized":"2024-04-26T22:22:07.589058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:14.316038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126242+0000","last_change":"2024-04-26T22:22:06.585240+0000","last_active":"2024-04-26T22:22:09.126242+0000","last_peered":"2024-04-26T22:22:09.126242+0000","last_clean":"2024-04-26T22:22:09.126242+0000","last_became_active":"2024-04-26T22:22:06.584998+0000","last_became_peered":"2024-04-26T22:22:06.584998+0000","last_unstale":"2024-04-26T22:22:09.126242+0000","last_undegraded":"2024-04-26T22:22:09.126242+0000","last_fullsized":"2024-04-26T22:22:09.126242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:02.943465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559528+0000","last_change":"2024-04-26T22:22:07.569561+0000","last_active":"2024-04-26T22:22:08.559528+0000","last_peered":"2024-04-26T22:22:08.559528+0000","last_clean":"2024-04-26T22:22:08.559528+0000","last_became_active":"2024-04-26T22:22:07.569280+0000","last_became_peered":"2024-04-26T22:22:07.569280+0000","last_unstale":"2024-04-26T22:22:08.559528+0000","last_undegraded":"2024-04-26T22:22:08.559528+0000","last_fullsized":"2024-04-26T22:22:08.559528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:08.568151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562973+0000","last_change":"2024-04-26T22:22:06.572113+0000","last_active":"2024-04-26T22:22:07.562973+0000","last_peered":"2024-04-26T22:22:07.562973+0000","last_clean":"2024-04-26T22:22:07.562973+0000","last_became_active":"2024-04-26T22:22:06.571835+0000","last_became_peered":"2024-04-26T22:22:06.571835+0000","last_unstale":"2024-04-26T22:22:07.562973+0000","last_undegraded":"2024-04-26T22:22:07.562973+0000","last_fullsized":"2024-04-26T22:22:07.562973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:33.522251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.588104+0000","last_change":"2024-04-26T22:22:07.574912+0000","last_active":"2024-04-26T22:22:07.588104+0000","last_peered":"2024-04-26T22:22:07.588104+0000","last_clean":"2024-04-26T22:22:07.588104+0000","last_became_active":"2024-04-26T22:22:07.574621+0000","last_became_peered":"2024-04-26T22:22:07.574621+0000","last_unstale":"2024-04-26T22:22:07.588104+0000","last_undegraded":"2024-04-26T22:22:07.588104+0000","last_fullsized":"2024-04-26T22:22:07.588104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:15.357174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125987+0000","last_change":"2024-04-26T22:22:06.581157+0000","last_active":"2024-04-26T22:22:09.125987+0000","last_peered":"2024-04-26T22:22:09.125987+0000","last_clean":"2024-04-26T22:22:09.125987+0000","last_became_active":"2024-04-26T22:22:06.580884+0000","last_became_peered":"2024-04-26T22:22:06.580884+0000","last_unstale":"2024-04-26T22:22:09.125987+0000","last_undegraded":"2024-04-26T22:22:09.125987+0000","last_fullsized":"2024-04-26T22:22:09.125987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126530+0000","last_change":"2024-04-26T22:22:07.595114+0000","last_active":"2024-04-26T22:22:09.126530+0000","last_peered":"2024-04-26T22:22:09.126530+0000","last_clean":"2024-04-26T22:22:09.126530+0000","last_became_active":"2024-04-26T22:22:07.594095+0000","last_became_peered":"2024-04-26T22:22:07.594095+0000","last_unstale":"2024-04-26T22:22:09.126530+0000","last_undegraded":"2024-04-26T22:22:09.126530+0000","last_fullsized":"2024-04-26T22:22:09.126530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560476+0000","last_change":"2024-04-26T22:22:06.569826+0000","last_active":"2024-04-26T22:22:08.560476+0000","last_peered":"2024-04-26T22:22:08.560476+0000","last_clean":"2024-04-26T22:22:08.560476+0000","last_became_active":"2024-04-26T22:22:06.569492+0000","last_became_peered":"2024-04-26T22:22:06.569492+0000","last_unstale":"2024-04-26T22:22:08.560476+0000","last_undegraded":"2024-04-26T22:22:08.560476+0000","last_fullsized":"2024-04-26T22:22:08.560476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:00.478031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559625+0000","last_change":"2024-04-26T22:22:07.574134+0000","last_active":"2024-04-26T22:22:08.559625+0000","last_peered":"2024-04-26T22:22:08.559625+0000","last_clean":"2024-04-26T22:22:08.559625+0000","last_became_active":"2024-04-26T22:22:07.573822+0000","last_became_peered":"2024-04-26T22:22:07.573822+0000","last_unstale":"2024-04-26T22:22:08.559625+0000","last_undegraded":"2024-04-26T22:22:08.559625+0000","last_fullsized":"2024-04-26T22:22:08.559625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:38.636045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126599+0000","last_change":"2024-04-26T22:22:06.569686+0000","last_active":"2024-04-26T22:22:09.126599+0000","last_peered":"2024-04-26T22:22:09.126599+0000","last_clean":"2024-04-26T22:22:09.126599+0000","last_became_active":"2024-04-26T22:22:06.569246+0000","last_became_peered":"2024-04-26T22:22:06.569246+0000","last_unstale":"2024-04-26T22:22:09.126599+0000","last_undegraded":"2024-04-26T22:22:09.126599+0000","last_fullsized":"2024-04-26T22:22:09.126599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:32.734230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127875+0000","last_change":"2024-04-26T22:22:07.583307+0000","last_active":"2024-04-26T22:22:09.127875+0000","last_peered":"2024-04-26T22:22:09.127875+0000","last_clean":"2024-04-26T22:22:09.127875+0000","last_became_active":"2024-04-26T22:22:07.583009+0000","last_became_peered":"2024-04-26T22:22:07.583009+0000","last_unstale":"2024-04-26T22:22:09.127875+0000","last_undegraded":"2024-04-26T22:22:09.127875+0000","last_fullsized":"2024-04-26T22:22:09.127875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:45.836913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559757+0000","last_change":"2024-04-26T22:22:06.571728+0000","last_active":"2024-04-26T22:22:08.559757+0000","last_peered":"2024-04-26T22:22:08.559757+0000","last_clean":"2024-04-26T22:22:08.559757+0000","last_became_active":"2024-04-26T22:22:06.569720+0000","last_became_peered":"2024-04-26T22:22:06.569720+0000","last_unstale":"2024-04-26T22:22:08.559757+0000","last_undegraded":"2024-04-26T22:22:08.559757+0000","last_fullsized":"2024-04-26T22:22:08.559757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:14.898488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127260+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:09.127260+0000","last_peered":"2024-04-26T22:22:09.127260+0000","last_clean":"2024-04-26T22:22:09.127260+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:09.127260+0000","last_undegraded":"2024-04-26T22:22:09.127260+0000","last_fullsized":"2024-04-26T22:22:09.127260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":129978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":123734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":129466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":124696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":123132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":124696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":713430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:11.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.862+0000 7fb09be00640 1 Processor -- start 2024-04-26T22:22:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.862+0000 7fb09be00640 1 -- start start 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb09be00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0941457c0 0x7fb094150a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb09be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb094075e50 con 0x7fb094075a70 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb09be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb09413f7c0 con 0x7fb0940b6700 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb09be00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fb0940b6bb0 con 0x7fb0941457c0 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb094075a70 0x7fb09413f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48080/0 (socket says 172.21.15.16:48080) 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099400640 1 -- 172.21.15.16:0/4107372734 learned_addr learned my addr 172.21.15.16:0/4107372734 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099e00640 1 --2- 172.21.15.16:0/4107372734 >> v2:172.21.15.195:3300/0 conn(0x7fb0941457c0 0x7fb094150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530369494 0 0) 0x7fb094075e50 con 0x7fb094075a70 2024-04-26T22:22:11.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb07c005740 con 0x7fb094075a70 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 479278171 0 0) 0x7fb07c005740 con 0x7fb094075a70 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 >> v2:172.21.15.195:3300/0 conn(0x7fb0941457c0 msgr2=0x7fb094150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 --2- 172.21.15.16:0/4107372734 >> v2:172.21.15.195:3300/0 conn(0x7fb0941457c0 0x7fb094150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 >> v1:172.21.15.195:6789/0 conn(0x7fb0940b6700 legacy=0x7fb0941450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0940b0b10 con 0x7fb094075a70 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7fb088001680 con 0x7fb094075a70 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 >> v1:172.21.15.16:6789/0 conn(0x7fb094075a70 legacy=0x7fb09413f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07c005bd0 0x7fb07c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb07c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07c0073e0 0x7fb07c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0940b6bb0 con 0x7fb07c006a20 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c00e280 con 0x7fb07c005bd0 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c00e480 con 0x7fb07c0073e0 2024-04-26T22:22:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb07c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099400640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07c005bd0 0x7fb07c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099e00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07c0073e0 0x7fb07c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 -- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07c0073e0 msgr2=0x7fb07c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb07c0073e0 0x7fb07c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 -- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07c005bd0 msgr2=0x7fb07c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb07c005bd0 0x7fb07c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb098a00640 1 -- 172.21.15.16:0/4107372734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c005740 con 0x7fb07c006a20 2024-04-26T22:22:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.866+0000 7fb099e00640 1 -- 172.21.15.16:0/4107372734 reap_dead start 2024-04-26T22:22:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb098a00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb07c006ea0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb0800017b0 tx=0x7fb08001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2973484df97afc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0800013d0 con 0x7fb07c006a20 2024-04-26T22:22:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0800052d0 con 0x7fb07c006a20 2024-04-26T22:22:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb093e00640 1 -- 172.21.15.16:0/4107372734 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080003650 con 0x7fb07c006a20 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 msgr2=0x7fb07c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb07c006ea0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb0800017b0 tx=0x7fb08001c3e0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- 172.21.15.16:0/4107372734 shutdown_connections 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 --2- 172.21.15.16:0/4107372734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb07c006ea0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- 172.21.15.16:0/4107372734 >> 172.21.15.16:0/4107372734 conn(0x7fb0940b6de0 msgr2=0x7fb0940b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- 172.21.15.16:0/4107372734 shutdown_connections 2024-04-26T22:22:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- 172.21.15.16:0/4107372734 wait complete. 2024-04-26T22:22:11.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 Processor -- start 2024-04-26T22:22:11.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.870+0000 7fb09be00640 1 -- start start 2024-04-26T22:22:11.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 0x7fb0941de600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 0x7fb0940b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb094070f50 con 0x7fb07c006a20 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb0940b10d0 con 0x7fb0941de180 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb0940af300 con 0x7fb0940b3860 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42928/0 (socket says 172.21.15.16:42928) 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 -- 172.21.15.16:0/2108615580 learned_addr learned my addr 172.21.15.16:0/2108615580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb098a00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 0x7fb0941de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099e00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 0x7fb0940b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 -- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 msgr2=0x7fb0940b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 0x7fb0940b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 -- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 msgr2=0x7fb0941de600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 0x7fb0941de600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 -- 172.21.15.16:0/2108615580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0941415e0 con 0x7fb07c006a20 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb098a00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 0x7fb0941de600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:11.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099e00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 0x7fb0940b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb099400640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0880118a0 tx=0x7fb088011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088010040 con 0x7fb07c006a20 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08801a070 con 0x7fb07c006a20 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08800fdc0 con 0x7fb07c006a20 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb094142250 con 0x7fb07c006a20 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09413fbd0 con 0x7fb07c006a20 2024-04-26T22:22:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb094140ed0 con 0x7fb07c006a20 2024-04-26T22:22:11.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.874+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb08801f460 con 0x7fb07c006a20 2024-04-26T22:22:11.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.878+0000 7fb091600640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:11.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.878+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb088089a60 con 0x7fb07c006a20 2024-04-26T22:22:11.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.878+0000 7fb098a00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:11.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.878+0000 7fb098a00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0800ac000 tx=0x7fb0800011f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:11.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:11.882+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb08805a010 con 0x7fb07c006a20 2024-04-26T22:22:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.042+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb094069530 con 0x7fb0740683b0 2024-04-26T22:22:12.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.050+0000 7fb091600640 1 -- 172.21.15.16:0/2108615580 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7fb094069530 con 0x7fb0740683b0 2024-04-26T22:22:12.056 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:12.057 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 msgr2=0x7fb07406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0800ac000 tx=0x7fb0800011f0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 msgr2=0x7fb094140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0880118a0 tx=0x7fb088011d60 comp rx=0 tx=0).stop 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 shutdown_connections 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb0740683b0 0x7fb07406a870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0940b3860 0x7fb0940b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0941de180 0x7fb0941de600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 --2- 172.21.15.16:0/2108615580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb07c006a20 0x7fb094140990 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 >> 172.21.15.16:0/2108615580 conn(0x7fb0940b6de0 msgr2=0x7fb0940b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 shutdown_connections 2024-04-26T22:22:12.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.054+0000 7fb09be00640 1 -- 172.21.15.16:0/2108615580 wait complete. 2024-04-26T22:22:12.076 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-26T22:22:10.111972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253256,"kb_used_data":3808,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721464,"statfs":{"total":773094113280,"available":772834779136,"internally_reserved":0,"allocated":3899392,"data_stored":2182652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.567455"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559744+0000","last_change":"2024-04-26T22:22:07.581325+0000","last_active":"2024-04-26T22:22:08.559744+0000","last_peered":"2024-04-26T22:22:08.559744+0000","last_clean":"2024-04-26T22:22:08.559744+0000","last_became_active":"2024-04-26T22:22:07.581060+0000","last_became_peered":"2024-04-26T22:22:07.581060+0000","last_unstale":"2024-04-26T22:22:08.559744+0000","last_undegraded":"2024-04-26T22:22:08.559744+0000","last_fullsized":"2024-04-26T22:22:08.559744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:17.524860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127780+0000","last_change":"2024-04-26T22:22:07.582609+0000","last_active":"2024-04-26T22:22:09.127780+0000","last_peered":"2024-04-26T22:22:09.127780+0000","last_clean":"2024-04-26T22:22:09.127780+0000","last_became_active":"2024-04-26T22:22:07.581185+0000","last_became_peered":"2024-04-26T22:22:07.581185+0000","last_unstale":"2024-04-26T22:22:09.127780+0000","last_undegraded":"2024-04-26T22:22:09.127780+0000","last_fullsized":"2024-04-26T22:22:09.127780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:18.064963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127362+0000","last_change":"2024-04-26T22:22:07.586535+0000","last_active":"2024-04-26T22:22:09.127362+0000","last_peered":"2024-04-26T22:22:09.127362+0000","last_clean":"2024-04-26T22:22:09.127362+0000","last_became_active":"2024-04-26T22:22:07.586319+0000","last_became_peered":"2024-04-26T22:22:07.586319+0000","last_unstale":"2024-04-26T22:22:09.127362+0000","last_undegraded":"2024-04-26T22:22:09.127362+0000","last_fullsized":"2024-04-26T22:22:09.127362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125950+0000","last_change":"2024-04-26T22:22:07.596196+0000","last_active":"2024-04-26T22:22:09.125950+0000","last_peered":"2024-04-26T22:22:09.125950+0000","last_clean":"2024-04-26T22:22:09.125950+0000","last_became_active":"2024-04-26T22:22:07.593918+0000","last_became_peered":"2024-04-26T22:22:07.593918+0000","last_unstale":"2024-04-26T22:22:09.125950+0000","last_undegraded":"2024-04-26T22:22:09.125950+0000","last_fullsized":"2024-04-26T22:22:09.125950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:13.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125986+0000","last_change":"2024-04-26T22:22:07.576884+0000","last_active":"2024-04-26T22:22:09.125986+0000","last_peered":"2024-04-26T22:22:09.125986+0000","last_clean":"2024-04-26T22:22:09.125986+0000","last_became_active":"2024-04-26T22:22:07.576585+0000","last_became_peered":"2024-04-26T22:22:07.576585+0000","last_unstale":"2024-04-26T22:22:09.125986+0000","last_undegraded":"2024-04-26T22:22:09.125986+0000","last_fullsized":"2024-04-26T22:22:09.125986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:01.485976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126487+0000","last_change":"2024-04-26T22:22:07.579200+0000","last_active":"2024-04-26T22:22:09.126487+0000","last_peered":"2024-04-26T22:22:09.126487+0000","last_clean":"2024-04-26T22:22:09.126487+0000","last_became_active":"2024-04-26T22:22:07.578668+0000","last_became_peered":"2024-04-26T22:22:07.578668+0000","last_unstale":"2024-04-26T22:22:09.126487+0000","last_undegraded":"2024-04-26T22:22:09.126487+0000","last_fullsized":"2024-04-26T22:22:09.126487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127368+0000","last_change":"2024-04-26T22:22:07.582092+0000","last_active":"2024-04-26T22:22:09.127368+0000","last_peered":"2024-04-26T22:22:09.127368+0000","last_clean":"2024-04-26T22:22:09.127368+0000","last_became_active":"2024-04-26T22:22:07.581824+0000","last_became_peered":"2024-04-26T22:22:07.581824+0000","last_unstale":"2024-04-26T22:22:09.127368+0000","last_undegraded":"2024-04-26T22:22:09.127368+0000","last_fullsized":"2024-04-26T22:22:09.127368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126856+0000","last_change":"2024-04-26T22:22:07.580997+0000","last_active":"2024-04-26T22:22:09.126856+0000","last_peered":"2024-04-26T22:22:09.126856+0000","last_clean":"2024-04-26T22:22:09.126856+0000","last_became_active":"2024-04-26T22:22:07.580698+0000","last_became_peered":"2024-04-26T22:22:07.580698+0000","last_unstale":"2024-04-26T22:22:09.126856+0000","last_undegraded":"2024-04-26T22:22:09.126856+0000","last_fullsized":"2024-04-26T22:22:09.126856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.561061+0000","last_change":"2024-04-26T22:22:07.594316+0000","last_active":"2024-04-26T22:22:08.561061+0000","last_peered":"2024-04-26T22:22:08.561061+0000","last_clean":"2024-04-26T22:22:08.561061+0000","last_became_active":"2024-04-26T22:22:07.593996+0000","last_became_peered":"2024-04-26T22:22:07.593996+0000","last_unstale":"2024-04-26T22:22:08.561061+0000","last_undegraded":"2024-04-26T22:22:08.561061+0000","last_fullsized":"2024-04-26T22:22:08.561061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127165+0000","last_change":"2024-04-26T22:22:07.596491+0000","last_active":"2024-04-26T22:22:09.127165+0000","last_peered":"2024-04-26T22:22:09.127165+0000","last_clean":"2024-04-26T22:22:09.127165+0000","last_became_active":"2024-04-26T22:22:07.596116+0000","last_became_peered":"2024-04-26T22:22:07.596116+0000","last_unstale":"2024-04-26T22:22:09.127165+0000","last_undegraded":"2024-04-26T22:22:09.127165+0000","last_fullsized":"2024-04-26T22:22:09.127165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127839+0000","last_change":"2024-04-26T22:22:07.594376+0000","last_active":"2024-04-26T22:22:09.127839+0000","last_peered":"2024-04-26T22:22:09.127839+0000","last_clean":"2024-04-26T22:22:09.127839+0000","last_became_active":"2024-04-26T22:22:07.594038+0000","last_became_peered":"2024-04-26T22:22:07.594038+0000","last_unstale":"2024-04-26T22:22:09.127839+0000","last_undegraded":"2024-04-26T22:22:09.127839+0000","last_fullsized":"2024-04-26T22:22:09.127839+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:08.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127086+0000","last_change":"2024-04-26T22:22:07.578714+0000","last_active":"2024-04-26T22:22:09.127086+0000","last_peered":"2024-04-26T22:22:09.127086+0000","last_clean":"2024-04-26T22:22:09.127086+0000","last_became_active":"2024-04-26T22:22:07.578460+0000","last_became_peered":"2024-04-26T22:22:07.578460+0000","last_unstale":"2024-04-26T22:22:09.127086+0000","last_undegraded":"2024-04-26T22:22:09.127086+0000","last_fullsized":"2024-04-26T22:22:09.127086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126155+0000","last_change":"2024-04-26T22:22:07.585450+0000","last_active":"2024-04-26T22:22:09.126155+0000","last_peered":"2024-04-26T22:22:09.126155+0000","last_clean":"2024-04-26T22:22:09.126155+0000","last_became_active":"2024-04-26T22:22:07.584037+0000","last_became_peered":"2024-04-26T22:22:07.584037+0000","last_unstale":"2024-04-26T22:22:09.126155+0000","last_undegraded":"2024-04-26T22:22:09.126155+0000","last_fullsized":"2024-04-26T22:22:09.126155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:45.954494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126663+0000","last_change":"2024-04-26T22:22:07.578920+0000","last_active":"2024-04-26T22:22:09.126663+0000","last_peered":"2024-04-26T22:22:09.126663+0000","last_clean":"2024-04-26T22:22:09.126663+0000","last_became_active":"2024-04-26T22:22:07.578246+0000","last_became_peered":"2024-04-26T22:22:07.578246+0000","last_unstale":"2024-04-26T22:22:09.126663+0000","last_undegraded":"2024-04-26T22:22:09.126663+0000","last_fullsized":"2024-04-26T22:22:09.126663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126782+0000","last_change":"2024-04-26T22:22:07.571554+0000","last_active":"2024-04-26T22:22:09.126782+0000","last_peered":"2024-04-26T22:22:09.126782+0000","last_clean":"2024-04-26T22:22:09.126782+0000","last_became_active":"2024-04-26T22:22:07.571250+0000","last_became_peered":"2024-04-26T22:22:07.571250+0000","last_unstale":"2024-04-26T22:22:09.126782+0000","last_undegraded":"2024-04-26T22:22:09.126782+0000","last_fullsized":"2024-04-26T22:22:09.126782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127206+0000","last_change":"2024-04-26T22:22:07.584527+0000","last_active":"2024-04-26T22:22:09.127206+0000","last_peered":"2024-04-26T22:22:09.127206+0000","last_clean":"2024-04-26T22:22:09.127206+0000","last_became_active":"2024-04-26T22:22:07.584157+0000","last_became_peered":"2024-04-26T22:22:07.584157+0000","last_unstale":"2024-04-26T22:22:09.127206+0000","last_undegraded":"2024-04-26T22:22:09.127206+0000","last_fullsized":"2024-04-26T22:22:09.127206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127875+0000","last_change":"2024-04-26T22:22:07.585024+0000","last_active":"2024-04-26T22:22:09.127875+0000","last_peered":"2024-04-26T22:22:09.127875+0000","last_clean":"2024-04-26T22:22:09.127875+0000","last_became_active":"2024-04-26T22:22:07.582273+0000","last_became_peered":"2024-04-26T22:22:07.582273+0000","last_unstale":"2024-04-26T22:22:09.127875+0000","last_undegraded":"2024-04-26T22:22:09.127875+0000","last_fullsized":"2024-04-26T22:22:09.127875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:55:23.866287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127783+0000","last_change":"2024-04-26T22:22:07.594012+0000","last_active":"2024-04-26T22:22:09.127783+0000","last_peered":"2024-04-26T22:22:09.127783+0000","last_clean":"2024-04-26T22:22:09.127783+0000","last_became_active":"2024-04-26T22:22:07.593698+0000","last_became_peered":"2024-04-26T22:22:07.593698+0000","last_unstale":"2024-04-26T22:22:09.127783+0000","last_undegraded":"2024-04-26T22:22:09.127783+0000","last_fullsized":"2024-04-26T22:22:09.127783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:45.836913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127609+0000","last_change":"2024-04-26T22:22:07.593768+0000","last_active":"2024-04-26T22:22:09.127609+0000","last_peered":"2024-04-26T22:22:09.127609+0000","last_clean":"2024-04-26T22:22:09.127609+0000","last_became_active":"2024-04-26T22:22:07.593220+0000","last_became_peered":"2024-04-26T22:22:07.593220+0000","last_unstale":"2024-04-26T22:22:09.127609+0000","last_undegraded":"2024-04-26T22:22:09.127609+0000","last_fullsized":"2024-04-26T22:22:09.127609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126469+0000","last_change":"2024-04-26T22:22:07.577229+0000","last_active":"2024-04-26T22:22:09.126469+0000","last_peered":"2024-04-26T22:22:09.126469+0000","last_clean":"2024-04-26T22:22:09.126469+0000","last_became_active":"2024-04-26T22:22:07.576961+0000","last_became_peered":"2024-04-26T22:22:07.576961+0000","last_unstale":"2024-04-26T22:22:09.126469+0000","last_undegraded":"2024-04-26T22:22:09.126469+0000","last_fullsized":"2024-04-26T22:22:09.126469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:03.462107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560016+0000","last_change":"2024-04-26T22:22:07.580919+0000","last_active":"2024-04-26T22:22:08.560016+0000","last_peered":"2024-04-26T22:22:08.560016+0000","last_clean":"2024-04-26T22:22:08.560016+0000","last_became_active":"2024-04-26T22:22:07.579976+0000","last_became_peered":"2024-04-26T22:22:07.579976+0000","last_unstale":"2024-04-26T22:22:08.560016+0000","last_undegraded":"2024-04-26T22:22:08.560016+0000","last_fullsized":"2024-04-26T22:22:08.560016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:40.522614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560126+0000","last_change":"2024-04-26T22:22:07.577317+0000","last_active":"2024-04-26T22:22:08.560126+0000","last_peered":"2024-04-26T22:22:08.560126+0000","last_clean":"2024-04-26T22:22:08.560126+0000","last_became_active":"2024-04-26T22:22:07.577005+0000","last_became_peered":"2024-04-26T22:22:07.577005+0000","last_unstale":"2024-04-26T22:22:08.560126+0000","last_undegraded":"2024-04-26T22:22:08.560126+0000","last_fullsized":"2024-04-26T22:22:08.560126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:17:21.302988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.584092+0000","last_change":"2024-04-26T22:22:07.572227+0000","last_active":"2024-04-26T22:22:07.584092+0000","last_peered":"2024-04-26T22:22:07.584092+0000","last_clean":"2024-04-26T22:22:07.584092+0000","last_became_active":"2024-04-26T22:22:07.571960+0000","last_became_peered":"2024-04-26T22:22:07.571960+0000","last_unstale":"2024-04-26T22:22:07.584092+0000","last_undegraded":"2024-04-26T22:22:07.584092+0000","last_fullsized":"2024-04-26T22:22:07.584092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.644074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126803+0000","last_change":"2024-04-26T22:22:07.581544+0000","last_active":"2024-04-26T22:22:09.126803+0000","last_peered":"2024-04-26T22:22:09.126803+0000","last_clean":"2024-04-26T22:22:09.126803+0000","last_became_active":"2024-04-26T22:22:07.580606+0000","last_became_peered":"2024-04-26T22:22:07.580606+0000","last_unstale":"2024-04-26T22:22:09.126803+0000","last_undegraded":"2024-04-26T22:22:09.126803+0000","last_fullsized":"2024-04-26T22:22:09.126803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126774+0000","last_change":"2024-04-26T22:22:07.594173+0000","last_active":"2024-04-26T22:22:09.126774+0000","last_peered":"2024-04-26T22:22:09.126774+0000","last_clean":"2024-04-26T22:22:09.126774+0000","last_became_active":"2024-04-26T22:22:07.593038+0000","last_became_peered":"2024-04-26T22:22:07.593038+0000","last_unstale":"2024-04-26T22:22:09.126774+0000","last_undegraded":"2024-04-26T22:22:09.126774+0000","last_fullsized":"2024-04-26T22:22:09.126774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127892+0000","last_change":"2024-04-26T22:22:07.572467+0000","last_active":"2024-04-26T22:22:09.127892+0000","last_peered":"2024-04-26T22:22:09.127892+0000","last_clean":"2024-04-26T22:22:09.127892+0000","last_became_active":"2024-04-26T22:22:07.572229+0000","last_became_peered":"2024-04-26T22:22:07.572229+0000","last_unstale":"2024-04-26T22:22:09.127892+0000","last_undegraded":"2024-04-26T22:22:09.127892+0000","last_fullsized":"2024-04-26T22:22:09.127892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:39.051856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126706+0000","last_change":"2024-04-26T22:22:07.596132+0000","last_active":"2024-04-26T22:22:09.126706+0000","last_peered":"2024-04-26T22:22:09.126706+0000","last_clean":"2024-04-26T22:22:09.126706+0000","last_became_active":"2024-04-26T22:22:07.595185+0000","last_became_peered":"2024-04-26T22:22:07.595185+0000","last_unstale":"2024-04-26T22:22:09.126706+0000","last_undegraded":"2024-04-26T22:22:09.126706+0000","last_fullsized":"2024-04-26T22:22:09.126706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127287+0000","last_change":"2024-04-26T22:22:07.573971+0000","last_active":"2024-04-26T22:22:09.127287+0000","last_peered":"2024-04-26T22:22:09.127287+0000","last_clean":"2024-04-26T22:22:09.127287+0000","last_became_active":"2024-04-26T22:22:07.573407+0000","last_became_peered":"2024-04-26T22:22:07.573407+0000","last_unstale":"2024-04-26T22:22:09.127287+0000","last_undegraded":"2024-04-26T22:22:09.127287+0000","last_fullsized":"2024-04-26T22:22:09.127287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560135+0000","last_change":"2024-04-26T22:22:07.575623+0000","last_active":"2024-04-26T22:22:08.560135+0000","last_peered":"2024-04-26T22:22:08.560135+0000","last_clean":"2024-04-26T22:22:08.560135+0000","last_became_active":"2024-04-26T22:22:07.575315+0000","last_became_peered":"2024-04-26T22:22:07.575315+0000","last_unstale":"2024-04-26T22:22:08.560135+0000","last_undegraded":"2024-04-26T22:22:08.560135+0000","last_fullsized":"2024-04-26T22:22:08.560135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:03.776408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127560+0000","last_change":"2024-04-26T22:22:07.578323+0000","last_active":"2024-04-26T22:22:09.127560+0000","last_peered":"2024-04-26T22:22:09.127560+0000","last_clean":"2024-04-26T22:22:09.127560+0000","last_became_active":"2024-04-26T22:22:07.577825+0000","last_became_peered":"2024-04-26T22:22:07.577825+0000","last_unstale":"2024-04-26T22:22:09.127560+0000","last_undegraded":"2024-04-26T22:22:09.127560+0000","last_fullsized":"2024-04-26T22:22:09.127560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559385+0000","last_change":"2024-04-26T22:22:07.581687+0000","last_active":"2024-04-26T22:22:08.559385+0000","last_peered":"2024-04-26T22:22:08.559385+0000","last_clean":"2024-04-26T22:22:08.559385+0000","last_became_active":"2024-04-26T22:22:07.581420+0000","last_became_peered":"2024-04-26T22:22:07.581420+0000","last_unstale":"2024-04-26T22:22:08.559385+0000","last_undegraded":"2024-04-26T22:22:08.559385+0000","last_fullsized":"2024-04-26T22:22:08.559385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:33.742176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126917+0000","last_change":"2024-04-26T22:22:07.588577+0000","last_active":"2024-04-26T22:22:09.126917+0000","last_peered":"2024-04-26T22:22:09.126917+0000","last_clean":"2024-04-26T22:22:09.126917+0000","last_became_active":"2024-04-26T22:22:07.587907+0000","last_became_peered":"2024-04-26T22:22:07.587907+0000","last_unstale":"2024-04-26T22:22:09.126917+0000","last_undegraded":"2024-04-26T22:22:09.126917+0000","last_fullsized":"2024-04-26T22:22:09.126917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:08:38.628357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.582992+0000","last_change":"2024-04-26T22:22:07.576656+0000","last_active":"2024-04-26T22:22:07.582992+0000","last_peered":"2024-04-26T22:22:07.582992+0000","last_clean":"2024-04-26T22:22:07.582992+0000","last_became_active":"2024-04-26T22:22:07.576401+0000","last_became_peered":"2024-04-26T22:22:07.576401+0000","last_unstale":"2024-04-26T22:22:07.582992+0000","last_undegraded":"2024-04-26T22:22:07.582992+0000","last_fullsized":"2024-04-26T22:22:07.582992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.772217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559834+0000","last_change":"2024-04-26T22:22:06.574181+0000","last_active":"2024-04-26T22:22:08.559834+0000","last_peered":"2024-04-26T22:22:08.559834+0000","last_clean":"2024-04-26T22:22:08.559834+0000","last_became_active":"2024-04-26T22:22:06.573553+0000","last_became_peered":"2024-04-26T22:22:06.573553+0000","last_unstale":"2024-04-26T22:22:08.559834+0000","last_undegraded":"2024-04-26T22:22:08.559834+0000","last_fullsized":"2024-04-26T22:22:08.559834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.454162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559735+0000","last_change":"2024-04-26T22:22:07.562642+0000","last_active":"2024-04-26T22:22:08.559735+0000","last_peered":"2024-04-26T22:22:08.559735+0000","last_clean":"2024-04-26T22:22:08.559735+0000","last_became_active":"2024-04-26T22:22:07.562363+0000","last_became_peered":"2024-04-26T22:22:07.562363+0000","last_unstale":"2024-04-26T22:22:08.559735+0000","last_undegraded":"2024-04-26T22:22:08.559735+0000","last_fullsized":"2024-04-26T22:22:08.559735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:57.185346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.599518+0000","last_change":"2024-04-26T22:22:06.576372+0000","last_active":"2024-04-26T22:22:07.599518+0000","last_peered":"2024-04-26T22:22:07.599518+0000","last_clean":"2024-04-26T22:22:07.599518+0000","last_became_active":"2024-04-26T22:22:06.576044+0000","last_became_peered":"2024-04-26T22:22:06.576044+0000","last_unstale":"2024-04-26T22:22:07.599518+0000","last_undegraded":"2024-04-26T22:22:07.599518+0000","last_fullsized":"2024-04-26T22:22:07.599518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:44.911556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560842+0000","last_change":"2024-04-26T22:22:07.579820+0000","last_active":"2024-04-26T22:22:08.560842+0000","last_peered":"2024-04-26T22:22:08.560842+0000","last_clean":"2024-04-26T22:22:08.560842+0000","last_became_active":"2024-04-26T22:22:07.579492+0000","last_became_peered":"2024-04-26T22:22:07.579492+0000","last_unstale":"2024-04-26T22:22:08.560842+0000","last_undegraded":"2024-04-26T22:22:08.560842+0000","last_fullsized":"2024-04-26T22:22:08.560842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127687+0000","last_change":"2024-04-26T22:22:06.581120+0000","last_active":"2024-04-26T22:22:09.127687+0000","last_peered":"2024-04-26T22:22:09.127687+0000","last_clean":"2024-04-26T22:22:09.127687+0000","last_became_active":"2024-04-26T22:22:06.580824+0000","last_became_peered":"2024-04-26T22:22:06.580824+0000","last_unstale":"2024-04-26T22:22:09.127687+0000","last_undegraded":"2024-04-26T22:22:09.127687+0000","last_fullsized":"2024-04-26T22:22:09.127687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:25.491791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126786+0000","last_change":"2024-04-26T22:22:07.597419+0000","last_active":"2024-04-26T22:22:09.126786+0000","last_peered":"2024-04-26T22:22:09.126786+0000","last_clean":"2024-04-26T22:22:09.126786+0000","last_became_active":"2024-04-26T22:22:07.595793+0000","last_became_peered":"2024-04-26T22:22:07.595793+0000","last_unstale":"2024-04-26T22:22:09.126786+0000","last_undegraded":"2024-04-26T22:22:09.126786+0000","last_fullsized":"2024-04-26T22:22:09.126786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126571+0000","last_change":"2024-04-26T22:22:06.581689+0000","last_active":"2024-04-26T22:22:09.126571+0000","last_peered":"2024-04-26T22:22:09.126571+0000","last_clean":"2024-04-26T22:22:09.126571+0000","last_became_active":"2024-04-26T22:22:06.581386+0000","last_became_peered":"2024-04-26T22:22:06.581386+0000","last_unstale":"2024-04-26T22:22:09.126571+0000","last_undegraded":"2024-04-26T22:22:09.126571+0000","last_fullsized":"2024-04-26T22:22:09.126571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.512350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127614+0000","last_change":"2024-04-26T22:22:07.583700+0000","last_active":"2024-04-26T22:22:09.127614+0000","last_peered":"2024-04-26T22:22:09.127614+0000","last_clean":"2024-04-26T22:22:09.127614+0000","last_became_active":"2024-04-26T22:22:07.583408+0000","last_became_peered":"2024-04-26T22:22:07.583408+0000","last_unstale":"2024-04-26T22:22:09.127614+0000","last_undegraded":"2024-04-26T22:22:09.127614+0000","last_fullsized":"2024-04-26T22:22:09.127614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560628+0000","last_change":"2024-04-26T22:22:06.570478+0000","last_active":"2024-04-26T22:22:08.560628+0000","last_peered":"2024-04-26T22:22:08.560628+0000","last_clean":"2024-04-26T22:22:08.560628+0000","last_became_active":"2024-04-26T22:22:06.570098+0000","last_became_peered":"2024-04-26T22:22:06.570098+0000","last_unstale":"2024-04-26T22:22:08.560628+0000","last_undegraded":"2024-04-26T22:22:08.560628+0000","last_fullsized":"2024-04-26T22:22:08.560628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:44.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127086+0000","last_change":"2024-04-26T22:22:07.577347+0000","last_active":"2024-04-26T22:22:09.127086+0000","last_peered":"2024-04-26T22:22:09.127086+0000","last_clean":"2024-04-26T22:22:09.127086+0000","last_became_active":"2024-04-26T22:22:07.577066+0000","last_became_peered":"2024-04-26T22:22:07.577066+0000","last_unstale":"2024-04-26T22:22:09.127086+0000","last_undegraded":"2024-04-26T22:22:09.127086+0000","last_fullsized":"2024-04-26T22:22:09.127086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:00.610184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560186+0000","last_change":"2024-04-26T22:22:06.564639+0000","last_active":"2024-04-26T22:22:08.560186+0000","last_peered":"2024-04-26T22:22:08.560186+0000","last_clean":"2024-04-26T22:22:08.560186+0000","last_became_active":"2024-04-26T22:22:06.564345+0000","last_became_peered":"2024-04-26T22:22:06.564345+0000","last_unstale":"2024-04-26T22:22:08.560186+0000","last_undegraded":"2024-04-26T22:22:08.560186+0000","last_fullsized":"2024-04-26T22:22:08.560186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:20.721292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559159+0000","last_change":"2024-04-26T22:22:07.565460+0000","last_active":"2024-04-26T22:22:08.559159+0000","last_peered":"2024-04-26T22:22:08.559159+0000","last_clean":"2024-04-26T22:22:08.559159+0000","last_became_active":"2024-04-26T22:22:07.565145+0000","last_became_peered":"2024-04-26T22:22:07.565145+0000","last_unstale":"2024-04-26T22:22:08.559159+0000","last_undegraded":"2024-04-26T22:22:08.559159+0000","last_fullsized":"2024-04-26T22:22:08.559159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:17.524860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126816+0000","last_change":"2024-04-26T22:22:06.568721+0000","last_active":"2024-04-26T22:22:09.126816+0000","last_peered":"2024-04-26T22:22:09.126816+0000","last_clean":"2024-04-26T22:22:09.126816+0000","last_became_active":"2024-04-26T22:22:06.568450+0000","last_became_peered":"2024-04-26T22:22:06.568450+0000","last_unstale":"2024-04-26T22:22:09.126816+0000","last_undegraded":"2024-04-26T22:22:09.126816+0000","last_fullsized":"2024-04-26T22:22:09.126816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:02.943465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126071+0000","last_change":"2024-04-26T22:22:07.585687+0000","last_active":"2024-04-26T22:22:09.126071+0000","last_peered":"2024-04-26T22:22:09.126071+0000","last_clean":"2024-04-26T22:22:09.126071+0000","last_became_active":"2024-04-26T22:22:07.585426+0000","last_became_peered":"2024-04-26T22:22:07.585426+0000","last_unstale":"2024-04-26T22:22:09.126071+0000","last_undegraded":"2024-04-26T22:22:09.126071+0000","last_fullsized":"2024-04-26T22:22:09.126071+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:33:54.112858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559211+0000","last_change":"2024-04-26T22:22:06.560748+0000","last_active":"2024-04-26T22:22:08.559211+0000","last_peered":"2024-04-26T22:22:08.559211+0000","last_clean":"2024-04-26T22:22:08.559211+0000","last_became_active":"2024-04-26T22:22:06.560438+0000","last_became_peered":"2024-04-26T22:22:06.560438+0000","last_unstale":"2024-04-26T22:22:08.559211+0000","last_undegraded":"2024-04-26T22:22:08.559211+0000","last_fullsized":"2024-04-26T22:22:08.559211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:38:09.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127766+0000","last_change":"2024-04-26T22:22:07.578851+0000","last_active":"2024-04-26T22:22:09.127766+0000","last_peered":"2024-04-26T22:22:09.127766+0000","last_clean":"2024-04-26T22:22:09.127766+0000","last_became_active":"2024-04-26T22:22:07.578597+0000","last_became_peered":"2024-04-26T22:22:07.578597+0000","last_unstale":"2024-04-26T22:22:09.127766+0000","last_undegraded":"2024-04-26T22:22:09.127766+0000","last_fullsized":"2024-04-26T22:22:09.127766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:59.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127768+0000","last_change":"2024-04-26T22:22:06.575175+0000","last_active":"2024-04-26T22:22:09.127768+0000","last_peered":"2024-04-26T22:22:09.127768+0000","last_clean":"2024-04-26T22:22:09.127768+0000","last_became_active":"2024-04-26T22:22:06.574799+0000","last_became_peered":"2024-04-26T22:22:06.574799+0000","last_unstale":"2024-04-26T22:22:09.127768+0000","last_undegraded":"2024-04-26T22:22:09.127768+0000","last_fullsized":"2024-04-26T22:22:09.127768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:16.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127763+0000","last_change":"2024-04-26T22:22:07.593853+0000","last_active":"2024-04-26T22:22:09.127763+0000","last_peered":"2024-04-26T22:22:09.127763+0000","last_clean":"2024-04-26T22:22:09.127763+0000","last_became_active":"2024-04-26T22:22:07.593459+0000","last_became_peered":"2024-04-26T22:22:07.593459+0000","last_unstale":"2024-04-26T22:22:09.127763+0000","last_undegraded":"2024-04-26T22:22:09.127763+0000","last_fullsized":"2024-04-26T22:22:09.127763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:55:23.866287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562504+0000","last_change":"2024-04-26T22:22:06.562972+0000","last_active":"2024-04-26T22:22:07.562504+0000","last_peered":"2024-04-26T22:22:07.562504+0000","last_clean":"2024-04-26T22:22:07.562504+0000","last_became_active":"2024-04-26T22:22:06.562678+0000","last_became_peered":"2024-04-26T22:22:06.562678+0000","last_unstale":"2024-04-26T22:22:07.562504+0000","last_undegraded":"2024-04-26T22:22:07.562504+0000","last_fullsized":"2024-04-26T22:22:07.562504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:12.384980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127696+0000","last_change":"2024-04-26T22:22:07.574354+0000","last_active":"2024-04-26T22:22:09.127696+0000","last_peered":"2024-04-26T22:22:09.127696+0000","last_clean":"2024-04-26T22:22:09.127696+0000","last_became_active":"2024-04-26T22:22:07.574029+0000","last_became_peered":"2024-04-26T22:22:07.574029+0000","last_unstale":"2024-04-26T22:22:09.127696+0000","last_undegraded":"2024-04-26T22:22:09.127696+0000","last_fullsized":"2024-04-26T22:22:09.127696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:08.702198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127400+0000","last_change":"2024-04-26T22:22:06.574798+0000","last_active":"2024-04-26T22:22:09.127400+0000","last_peered":"2024-04-26T22:22:09.127400+0000","last_clean":"2024-04-26T22:22:09.127400+0000","last_became_active":"2024-04-26T22:22:06.574302+0000","last_became_peered":"2024-04-26T22:22:06.574302+0000","last_unstale":"2024-04-26T22:22:09.127400+0000","last_undegraded":"2024-04-26T22:22:09.127400+0000","last_fullsized":"2024-04-26T22:22:09.127400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127313+0000","last_change":"2024-04-26T22:22:07.586831+0000","last_active":"2024-04-26T22:22:09.127313+0000","last_peered":"2024-04-26T22:22:09.127313+0000","last_clean":"2024-04-26T22:22:09.127313+0000","last_became_active":"2024-04-26T22:22:07.585557+0000","last_became_peered":"2024-04-26T22:22:07.585557+0000","last_unstale":"2024-04-26T22:22:09.127313+0000","last_undegraded":"2024-04-26T22:22:09.127313+0000","last_fullsized":"2024-04-26T22:22:09.127313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:32:54.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127636+0000","last_change":"2024-04-26T22:22:06.580344+0000","last_active":"2024-04-26T22:22:09.127636+0000","last_peered":"2024-04-26T22:22:09.127636+0000","last_clean":"2024-04-26T22:22:09.127636+0000","last_became_active":"2024-04-26T22:22:06.580102+0000","last_became_peered":"2024-04-26T22:22:06.580102+0000","last_unstale":"2024-04-26T22:22:09.127636+0000","last_undegraded":"2024-04-26T22:22:09.127636+0000","last_fullsized":"2024-04-26T22:22:09.127636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:56.177401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125780+0000","last_change":"2024-04-26T22:22:07.580027+0000","last_active":"2024-04-26T22:22:09.125780+0000","last_peered":"2024-04-26T22:22:09.125780+0000","last_clean":"2024-04-26T22:22:09.125780+0000","last_became_active":"2024-04-26T22:22:07.578401+0000","last_became_peered":"2024-04-26T22:22:07.578401+0000","last_unstale":"2024-04-26T22:22:09.125780+0000","last_undegraded":"2024-04-26T22:22:09.125780+0000","last_fullsized":"2024-04-26T22:22:09.125780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:03.776408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560637+0000","last_change":"2024-04-26T22:22:06.560985+0000","last_active":"2024-04-26T22:22:08.560637+0000","last_peered":"2024-04-26T22:22:08.560637+0000","last_clean":"2024-04-26T22:22:08.560637+0000","last_became_active":"2024-04-26T22:22:06.560481+0000","last_became_peered":"2024-04-26T22:22:06.560481+0000","last_unstale":"2024-04-26T22:22:08.560637+0000","last_undegraded":"2024-04-26T22:22:08.560637+0000","last_fullsized":"2024-04-26T22:22:08.560637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.454162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127419+0000","last_change":"2024-04-26T22:22:07.583042+0000","last_active":"2024-04-26T22:22:09.127419+0000","last_peered":"2024-04-26T22:22:09.127419+0000","last_clean":"2024-04-26T22:22:09.127419+0000","last_became_active":"2024-04-26T22:22:07.581160+0000","last_became_peered":"2024-04-26T22:22:07.581160+0000","last_unstale":"2024-04-26T22:22:09.127419+0000","last_undegraded":"2024-04-26T22:22:09.127419+0000","last_fullsized":"2024-04-26T22:22:09.127419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125967+0000","last_change":"2024-04-26T22:22:06.575284+0000","last_active":"2024-04-26T22:22:09.125967+0000","last_peered":"2024-04-26T22:22:09.125967+0000","last_clean":"2024-04-26T22:22:09.125967+0000","last_became_active":"2024-04-26T22:22:06.574988+0000","last_became_peered":"2024-04-26T22:22:06.574988+0000","last_unstale":"2024-04-26T22:22:09.125967+0000","last_undegraded":"2024-04-26T22:22:09.125967+0000","last_fullsized":"2024-04-26T22:22:09.125967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:57:49.587337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127167+0000","last_change":"2024-04-26T22:22:07.588806+0000","last_active":"2024-04-26T22:22:09.127167+0000","last_peered":"2024-04-26T22:22:09.127167+0000","last_clean":"2024-04-26T22:22:09.127167+0000","last_became_active":"2024-04-26T22:22:07.588410+0000","last_became_peered":"2024-04-26T22:22:07.588410+0000","last_unstale":"2024-04-26T22:22:09.127167+0000","last_undegraded":"2024-04-26T22:22:09.127167+0000","last_fullsized":"2024-04-26T22:22:09.127167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:55.642103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126772+0000","last_change":"2024-04-26T22:22:06.574821+0000","last_active":"2024-04-26T22:22:09.126772+0000","last_peered":"2024-04-26T22:22:09.126772+0000","last_clean":"2024-04-26T22:22:09.126772+0000","last_became_active":"2024-04-26T22:22:06.574550+0000","last_became_peered":"2024-04-26T22:22:06.574550+0000","last_unstale":"2024-04-26T22:22:09.126772+0000","last_undegraded":"2024-04-26T22:22:09.126772+0000","last_fullsized":"2024-04-26T22:22:09.126772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559526+0000","last_change":"2024-04-26T22:22:07.562266+0000","last_active":"2024-04-26T22:22:08.559526+0000","last_peered":"2024-04-26T22:22:08.559526+0000","last_clean":"2024-04-26T22:22:08.559526+0000","last_became_active":"2024-04-26T22:22:07.561862+0000","last_became_peered":"2024-04-26T22:22:07.561862+0000","last_unstale":"2024-04-26T22:22:08.559526+0000","last_undegraded":"2024-04-26T22:22:08.559526+0000","last_fullsized":"2024-04-26T22:22:08.559526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:26.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126659+0000","last_change":"2024-04-26T22:22:06.573021+0000","last_active":"2024-04-26T22:22:09.126659+0000","last_peered":"2024-04-26T22:22:09.126659+0000","last_clean":"2024-04-26T22:22:09.126659+0000","last_became_active":"2024-04-26T22:22:06.572674+0000","last_became_peered":"2024-04-26T22:22:06.572674+0000","last_unstale":"2024-04-26T22:22:09.126659+0000","last_undegraded":"2024-04-26T22:22:09.126659+0000","last_fullsized":"2024-04-26T22:22:09.126659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:07.560206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560830+0000","last_change":"2024-04-26T22:22:07.573094+0000","last_active":"2024-04-26T22:22:08.560830+0000","last_peered":"2024-04-26T22:22:08.560830+0000","last_clean":"2024-04-26T22:22:08.560830+0000","last_became_active":"2024-04-26T22:22:07.572833+0000","last_became_peered":"2024-04-26T22:22:07.572833+0000","last_unstale":"2024-04-26T22:22:08.560830+0000","last_undegraded":"2024-04-26T22:22:08.560830+0000","last_fullsized":"2024-04-26T22:22:08.560830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:13.499241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126972+0000","last_change":"2024-04-26T22:22:06.578545+0000","last_active":"2024-04-26T22:22:09.126972+0000","last_peered":"2024-04-26T22:22:09.126972+0000","last_clean":"2024-04-26T22:22:09.126972+0000","last_became_active":"2024-04-26T22:22:06.577596+0000","last_became_peered":"2024-04-26T22:22:06.577596+0000","last_unstale":"2024-04-26T22:22:09.126972+0000","last_undegraded":"2024-04-26T22:22:09.126972+0000","last_fullsized":"2024-04-26T22:22:09.126972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:32.734230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127890+0000","last_change":"2024-04-26T22:22:07.572768+0000","last_active":"2024-04-26T22:22:09.127890+0000","last_peered":"2024-04-26T22:22:09.127890+0000","last_clean":"2024-04-26T22:22:09.127890+0000","last_became_active":"2024-04-26T22:22:07.572417+0000","last_became_peered":"2024-04-26T22:22:07.572417+0000","last_unstale":"2024-04-26T22:22:09.127890+0000","last_undegraded":"2024-04-26T22:22:09.127890+0000","last_fullsized":"2024-04-26T22:22:09.127890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:16:44.455462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560946+0000","last_change":"2024-04-26T22:22:06.563144+0000","last_active":"2024-04-26T22:22:08.560946+0000","last_peered":"2024-04-26T22:22:08.560946+0000","last_clean":"2024-04-26T22:22:08.560946+0000","last_became_active":"2024-04-26T22:22:06.562869+0000","last_became_peered":"2024-04-26T22:22:06.562869+0000","last_unstale":"2024-04-26T22:22:08.560946+0000","last_undegraded":"2024-04-26T22:22:08.560946+0000","last_fullsized":"2024-04-26T22:22:08.560946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:01.478581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126127+0000","last_change":"2024-04-26T22:22:07.594278+0000","last_active":"2024-04-26T22:22:09.126127+0000","last_peered":"2024-04-26T22:22:09.126127+0000","last_clean":"2024-04-26T22:22:09.126127+0000","last_became_active":"2024-04-26T22:22:07.593507+0000","last_became_peered":"2024-04-26T22:22:07.593507+0000","last_unstale":"2024-04-26T22:22:09.126127+0000","last_undegraded":"2024-04-26T22:22:09.126127+0000","last_fullsized":"2024-04-26T22:22:09.126127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:25.916049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560850+0000","last_change":"2024-04-26T22:22:06.573022+0000","last_active":"2024-04-26T22:22:08.560850+0000","last_peered":"2024-04-26T22:22:08.560850+0000","last_clean":"2024-04-26T22:22:08.560850+0000","last_became_active":"2024-04-26T22:22:06.568895+0000","last_became_peered":"2024-04-26T22:22:06.568895+0000","last_unstale":"2024-04-26T22:22:08.560850+0000","last_undegraded":"2024-04-26T22:22:08.560850+0000","last_fullsized":"2024-04-26T22:22:08.560850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:05:55.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126350+0000","last_change":"2024-04-26T22:22:07.581357+0000","last_active":"2024-04-26T22:22:09.126350+0000","last_peered":"2024-04-26T22:22:09.126350+0000","last_clean":"2024-04-26T22:22:09.126350+0000","last_became_active":"2024-04-26T22:22:07.581097+0000","last_became_peered":"2024-04-26T22:22:07.581097+0000","last_unstale":"2024-04-26T22:22:09.126350+0000","last_undegraded":"2024-04-26T22:22:09.126350+0000","last_fullsized":"2024-04-26T22:22:09.126350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:15.906434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560804+0000","last_change":"2024-04-26T22:22:06.570535+0000","last_active":"2024-04-26T22:22:08.560804+0000","last_peered":"2024-04-26T22:22:08.560804+0000","last_clean":"2024-04-26T22:22:08.560804+0000","last_became_active":"2024-04-26T22:22:06.570181+0000","last_became_peered":"2024-04-26T22:22:06.570181+0000","last_unstale":"2024-04-26T22:22:08.560804+0000","last_undegraded":"2024-04-26T22:22:08.560804+0000","last_fullsized":"2024-04-26T22:22:08.560804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:14.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126250+0000","last_change":"2024-04-26T22:22:07.564835+0000","last_active":"2024-04-26T22:22:09.126250+0000","last_peered":"2024-04-26T22:22:09.126250+0000","last_clean":"2024-04-26T22:22:09.126250+0000","last_became_active":"2024-04-26T22:22:07.561982+0000","last_became_peered":"2024-04-26T22:22:07.561982+0000","last_unstale":"2024-04-26T22:22:09.126250+0000","last_undegraded":"2024-04-26T22:22:09.126250+0000","last_fullsized":"2024-04-26T22:22:09.126250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:02.486527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.602674+0000","last_change":"2024-04-26T22:22:06.582173+0000","last_active":"2024-04-26T22:22:07.602674+0000","last_peered":"2024-04-26T22:22:07.602674+0000","last_clean":"2024-04-26T22:22:07.602674+0000","last_became_active":"2024-04-26T22:22:06.581678+0000","last_became_peered":"2024-04-26T22:22:06.581678+0000","last_unstale":"2024-04-26T22:22:07.602674+0000","last_undegraded":"2024-04-26T22:22:07.602674+0000","last_fullsized":"2024-04-26T22:22:07.602674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:07:30.803202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127179+0000","last_change":"2024-04-26T22:22:07.580016+0000","last_active":"2024-04-26T22:22:09.127179+0000","last_peered":"2024-04-26T22:22:09.127179+0000","last_clean":"2024-04-26T22:22:09.127179+0000","last_became_active":"2024-04-26T22:22:07.579705+0000","last_became_peered":"2024-04-26T22:22:07.579705+0000","last_unstale":"2024-04-26T22:22:09.127179+0000","last_undegraded":"2024-04-26T22:22:09.127179+0000","last_fullsized":"2024-04-26T22:22:09.127179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:41.173346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559857+0000","last_change":"2024-04-26T22:22:06.580423+0000","last_active":"2024-04-26T22:22:08.559857+0000","last_peered":"2024-04-26T22:22:08.559857+0000","last_clean":"2024-04-26T22:22:08.559857+0000","last_became_active":"2024-04-26T22:22:06.579838+0000","last_became_peered":"2024-04-26T22:22:06.579838+0000","last_unstale":"2024-04-26T22:22:08.559857+0000","last_undegraded":"2024-04-26T22:22:08.559857+0000","last_fullsized":"2024-04-26T22:22:08.559857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:20.721292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126088+0000","last_change":"2024-04-26T22:22:07.573636+0000","last_active":"2024-04-26T22:22:09.126088+0000","last_peered":"2024-04-26T22:22:09.126088+0000","last_clean":"2024-04-26T22:22:09.126088+0000","last_became_active":"2024-04-26T22:22:07.572556+0000","last_became_peered":"2024-04-26T22:22:07.572556+0000","last_unstale":"2024-04-26T22:22:09.126088+0000","last_undegraded":"2024-04-26T22:22:09.126088+0000","last_fullsized":"2024-04-26T22:22:09.126088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:56:15.590780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559744+0000","last_change":"2024-04-26T22:22:06.580094+0000","last_active":"2024-04-26T22:22:08.559744+0000","last_peered":"2024-04-26T22:22:08.559744+0000","last_clean":"2024-04-26T22:22:08.559744+0000","last_became_active":"2024-04-26T22:22:06.579628+0000","last_became_peered":"2024-04-26T22:22:06.579628+0000","last_unstale":"2024-04-26T22:22:08.559744+0000","last_undegraded":"2024-04-26T22:22:08.559744+0000","last_fullsized":"2024-04-26T22:22:08.559744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:14.898488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127362+0000","last_change":"2024-04-26T22:22:07.586265+0000","last_active":"2024-04-26T22:22:09.127362+0000","last_peered":"2024-04-26T22:22:09.127362+0000","last_clean":"2024-04-26T22:22:09.127362+0000","last_became_active":"2024-04-26T22:22:07.583555+0000","last_became_peered":"2024-04-26T22:22:07.583555+0000","last_unstale":"2024-04-26T22:22:09.127362+0000","last_undegraded":"2024-04-26T22:22:09.127362+0000","last_fullsized":"2024-04-26T22:22:09.127362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126703+0000","last_change":"2024-04-26T22:22:06.575950+0000","last_active":"2024-04-26T22:22:09.126703+0000","last_peered":"2024-04-26T22:22:09.126703+0000","last_clean":"2024-04-26T22:22:09.126703+0000","last_became_active":"2024-04-26T22:22:06.575699+0000","last_became_peered":"2024-04-26T22:22:06.575699+0000","last_unstale":"2024-04-26T22:22:09.126703+0000","last_undegraded":"2024-04-26T22:22:09.126703+0000","last_fullsized":"2024-04-26T22:22:09.126703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:57:49.587337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126370+0000","last_change":"2024-04-26T22:22:07.581695+0000","last_active":"2024-04-26T22:22:09.126370+0000","last_peered":"2024-04-26T22:22:09.126370+0000","last_clean":"2024-04-26T22:22:09.126370+0000","last_became_active":"2024-04-26T22:22:07.580477+0000","last_became_peered":"2024-04-26T22:22:07.580477+0000","last_unstale":"2024-04-26T22:22:09.126370+0000","last_undegraded":"2024-04-26T22:22:09.126370+0000","last_fullsized":"2024-04-26T22:22:09.126370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:21.729238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127094+0000","last_change":"2024-04-26T22:22:06.584443+0000","last_active":"2024-04-26T22:22:09.127094+0000","last_peered":"2024-04-26T22:22:09.127094+0000","last_clean":"2024-04-26T22:22:09.127094+0000","last_became_active":"2024-04-26T22:22:06.580948+0000","last_became_peered":"2024-04-26T22:22:06.580948+0000","last_unstale":"2024-04-26T22:22:09.127094+0000","last_undegraded":"2024-04-26T22:22:09.127094+0000","last_fullsized":"2024-04-26T22:22:09.127094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:07.560206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.128059+0000","last_change":"2024-04-26T22:22:07.592297+0000","last_active":"2024-04-26T22:22:09.128059+0000","last_peered":"2024-04-26T22:22:09.128059+0000","last_clean":"2024-04-26T22:22:09.128059+0000","last_became_active":"2024-04-26T22:22:07.592031+0000","last_became_peered":"2024-04-26T22:22:07.592031+0000","last_unstale":"2024-04-26T22:22:09.128059+0000","last_undegraded":"2024-04-26T22:22:09.128059+0000","last_fullsized":"2024-04-26T22:22:09.128059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:23:49.894076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562347+0000","last_change":"2024-04-26T22:22:06.580372+0000","last_active":"2024-04-26T22:22:07.562347+0000","last_peered":"2024-04-26T22:22:07.562347+0000","last_clean":"2024-04-26T22:22:07.562347+0000","last_became_active":"2024-04-26T22:22:06.580095+0000","last_became_peered":"2024-04-26T22:22:06.580095+0000","last_unstale":"2024-04-26T22:22:07.562347+0000","last_undegraded":"2024-04-26T22:22:07.562347+0000","last_fullsized":"2024-04-26T22:22:07.562347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:47.956280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.589058+0000","last_change":"2024-04-26T22:22:07.578669+0000","last_active":"2024-04-26T22:22:07.589058+0000","last_peered":"2024-04-26T22:22:07.589058+0000","last_clean":"2024-04-26T22:22:07.589058+0000","last_became_active":"2024-04-26T22:22:07.578369+0000","last_became_peered":"2024-04-26T22:22:07.578369+0000","last_unstale":"2024-04-26T22:22:07.589058+0000","last_undegraded":"2024-04-26T22:22:07.589058+0000","last_fullsized":"2024-04-26T22:22:07.589058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:14.316038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126242+0000","last_change":"2024-04-26T22:22:06.585240+0000","last_active":"2024-04-26T22:22:09.126242+0000","last_peered":"2024-04-26T22:22:09.126242+0000","last_clean":"2024-04-26T22:22:09.126242+0000","last_became_active":"2024-04-26T22:22:06.584998+0000","last_became_peered":"2024-04-26T22:22:06.584998+0000","last_unstale":"2024-04-26T22:22:09.126242+0000","last_undegraded":"2024-04-26T22:22:09.126242+0000","last_fullsized":"2024-04-26T22:22:09.126242+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:02.943465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559528+0000","last_change":"2024-04-26T22:22:07.569561+0000","last_active":"2024-04-26T22:22:08.559528+0000","last_peered":"2024-04-26T22:22:08.559528+0000","last_clean":"2024-04-26T22:22:08.559528+0000","last_became_active":"2024-04-26T22:22:07.569280+0000","last_became_peered":"2024-04-26T22:22:07.569280+0000","last_unstale":"2024-04-26T22:22:08.559528+0000","last_undegraded":"2024-04-26T22:22:08.559528+0000","last_fullsized":"2024-04-26T22:22:08.559528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:08.568151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.562973+0000","last_change":"2024-04-26T22:22:06.572113+0000","last_active":"2024-04-26T22:22:07.562973+0000","last_peered":"2024-04-26T22:22:07.562973+0000","last_clean":"2024-04-26T22:22:07.562973+0000","last_became_active":"2024-04-26T22:22:06.571835+0000","last_became_peered":"2024-04-26T22:22:06.571835+0000","last_unstale":"2024-04-26T22:22:07.562973+0000","last_undegraded":"2024-04-26T22:22:07.562973+0000","last_fullsized":"2024-04-26T22:22:07.562973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:16:33.522251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T22:22:07.588104+0000","last_change":"2024-04-26T22:22:07.574912+0000","last_active":"2024-04-26T22:22:07.588104+0000","last_peered":"2024-04-26T22:22:07.588104+0000","last_clean":"2024-04-26T22:22:07.588104+0000","last_became_active":"2024-04-26T22:22:07.574621+0000","last_became_peered":"2024-04-26T22:22:07.574621+0000","last_unstale":"2024-04-26T22:22:07.588104+0000","last_undegraded":"2024-04-26T22:22:07.588104+0000","last_fullsized":"2024-04-26T22:22:07.588104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:19:15.357174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.125987+0000","last_change":"2024-04-26T22:22:06.581157+0000","last_active":"2024-04-26T22:22:09.125987+0000","last_peered":"2024-04-26T22:22:09.125987+0000","last_clean":"2024-04-26T22:22:09.125987+0000","last_became_active":"2024-04-26T22:22:06.580884+0000","last_became_peered":"2024-04-26T22:22:06.580884+0000","last_unstale":"2024-04-26T22:22:09.125987+0000","last_undegraded":"2024-04-26T22:22:09.125987+0000","last_fullsized":"2024-04-26T22:22:09.125987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:31.944749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126530+0000","last_change":"2024-04-26T22:22:07.595114+0000","last_active":"2024-04-26T22:22:09.126530+0000","last_peered":"2024-04-26T22:22:09.126530+0000","last_clean":"2024-04-26T22:22:09.126530+0000","last_became_active":"2024-04-26T22:22:07.594095+0000","last_became_peered":"2024-04-26T22:22:07.594095+0000","last_unstale":"2024-04-26T22:22:09.126530+0000","last_undegraded":"2024-04-26T22:22:09.126530+0000","last_fullsized":"2024-04-26T22:22:09.126530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:54.951749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.560476+0000","last_change":"2024-04-26T22:22:06.569826+0000","last_active":"2024-04-26T22:22:08.560476+0000","last_peered":"2024-04-26T22:22:08.560476+0000","last_clean":"2024-04-26T22:22:08.560476+0000","last_became_active":"2024-04-26T22:22:06.569492+0000","last_became_peered":"2024-04-26T22:22:06.569492+0000","last_unstale":"2024-04-26T22:22:08.560476+0000","last_undegraded":"2024-04-26T22:22:08.560476+0000","last_fullsized":"2024-04-26T22:22:08.560476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:00.478031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559625+0000","last_change":"2024-04-26T22:22:07.574134+0000","last_active":"2024-04-26T22:22:08.559625+0000","last_peered":"2024-04-26T22:22:08.559625+0000","last_clean":"2024-04-26T22:22:08.559625+0000","last_became_active":"2024-04-26T22:22:07.573822+0000","last_became_peered":"2024-04-26T22:22:07.573822+0000","last_unstale":"2024-04-26T22:22:08.559625+0000","last_undegraded":"2024-04-26T22:22:08.559625+0000","last_fullsized":"2024-04-26T22:22:08.559625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:38.636045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.126599+0000","last_change":"2024-04-26T22:22:06.569686+0000","last_active":"2024-04-26T22:22:09.126599+0000","last_peered":"2024-04-26T22:22:09.126599+0000","last_clean":"2024-04-26T22:22:09.126599+0000","last_became_active":"2024-04-26T22:22:06.569246+0000","last_became_peered":"2024-04-26T22:22:06.569246+0000","last_unstale":"2024-04-26T22:22:09.126599+0000","last_undegraded":"2024-04-26T22:22:09.126599+0000","last_fullsized":"2024-04-26T22:22:09.126599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:32.734230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127875+0000","last_change":"2024-04-26T22:22:07.583307+0000","last_active":"2024-04-26T22:22:09.127875+0000","last_peered":"2024-04-26T22:22:09.127875+0000","last_clean":"2024-04-26T22:22:09.127875+0000","last_became_active":"2024-04-26T22:22:07.583009+0000","last_became_peered":"2024-04-26T22:22:07.583009+0000","last_unstale":"2024-04-26T22:22:09.127875+0000","last_undegraded":"2024-04-26T22:22:09.127875+0000","last_fullsized":"2024-04-26T22:22:09.127875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:06.543669+0000","last_clean_scrub_stamp":"2024-04-26T22:22:06.543669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:45.836913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:08.559757+0000","last_change":"2024-04-26T22:22:06.571728+0000","last_active":"2024-04-26T22:22:08.559757+0000","last_peered":"2024-04-26T22:22:08.559757+0000","last_clean":"2024-04-26T22:22:08.559757+0000","last_became_active":"2024-04-26T22:22:06.569720+0000","last_became_peered":"2024-04-26T22:22:06.569720+0000","last_unstale":"2024-04-26T22:22:08.559757+0000","last_undegraded":"2024-04-26T22:22:08.559757+0000","last_fullsized":"2024-04-26T22:22:08.559757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:22:05.535724+0000","last_clean_scrub_stamp":"2024-04-26T22:22:05.535724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:14.898488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T22:22:09.127260+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:09.127260+0000","last_peered":"2024-04-26T22:22:09.127260+0000","last_clean":"2024-04-26T22:22:09.127260+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:09.127260+0000","last_undegraded":"2024-04-26T22:22:09.127260+0000","last_fullsized":"2024-04-26T22:22:09.127260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":129978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":123734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":348160,"data_stored":129466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":124696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":331776,"data_stored":123132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":344064,"data_stored":124696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":713430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:22:12.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:22:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 Processor -- start 2024-04-26T22:22:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 -- start start 2024-04-26T22:22:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f527006e410 0x7f52700b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f527013eec0 0x7f527013f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527006e7f0 con 0x7f52701465c0 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5270070a40 con 0x7f527006e410 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f5274c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5270070760 con 0x7f527013eec0 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f526de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f527006e410 0x7f52700b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f526de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f527006e410 0x7f52700b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42936/0 (socket says 172.21.15.16:42936) 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.262+0000 7f526de00640 1 -- 172.21.15.16:0/4220508753 learned_addr learned my addr 172.21.15.16:0/4220508753 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526e800640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f527013eec0 0x7f527013f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526de00640 1 -- 172.21.15.16:0/4220508753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f527013eec0 msgr2=0x7f527013f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526de00640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f527013eec0 0x7f527013f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526de00640 1 -- 172.21.15.16:0/4220508753 >> v1:172.21.15.195:6789/0 conn(0x7f52701465c0 legacy=0x7f5270149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526de00640 1 -- 172.21.15.16:0/4220508753 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5270148860 con 0x7f527006e410 2024-04-26T22:22:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526de00640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527006e410 0x7f52700b30d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5260009870 tx=0x7f526001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46589cfe2df4aa2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526d400640 1 -- 172.21.15.16:0/4220508753 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52600b1070 con 0x7f527006e410 2024-04-26T22:22:12.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526d400640 1 -- 172.21.15.16:0/4220508753 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52600ac620 con 0x7f527006e410 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f526d400640 1 -- 172.21.15.16:0/4220508753 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52600ac9f0 con 0x7f527006e410 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f5274c00640 1 -- 172.21.15.16:0/4220508753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527006e410 msgr2=0x7f52700b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.266+0000 7f5274c00640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527006e410 0x7f52700b30d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5260009870 tx=0x7f526001c4d0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- 172.21.15.16:0/4220508753 shutdown_connections 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f527013eec0 0x7f527013f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 --2- 172.21.15.16:0/4220508753 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527006e410 0x7f52700b30d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- 172.21.15.16:0/4220508753 >> 172.21.15.16:0/4220508753 conn(0x7f52700b6590 msgr2=0x7f52700b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- 172.21.15.16:0/4220508753 shutdown_connections 2024-04-26T22:22:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- 172.21.15.16:0/4220508753 wait complete. 2024-04-26T22:22:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 Processor -- start 2024-04-26T22:22:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- start start 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f527006e410 0x7f5270139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52701465c0 0x7f5270141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5270152600 con 0x7f527013eec0 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5270152480 con 0x7f527006e410 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5270152780 con 0x7f52701465c0 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42952/0 (socket says 172.21.15.16:42952) 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 -- 172.21.15.16:0/199029508 learned_addr learned my addr 172.21.15.16:0/199029508 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f526e800640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52701465c0 0x7f5270141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f526de00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f527006e410 0x7f5270139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 -- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52701465c0 msgr2=0x7f5270141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52701465c0 0x7f5270141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 -- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f527006e410 msgr2=0x7f5270139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f527006e410 0x7f5270139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 -- 172.21.15.16:0/199029508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5270141160 con 0x7f527013eec0 2024-04-26T22:22:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5267e00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f525800c500 tx=0x7f525800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258016020 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258005220 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258007030 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.270+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527013a390 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5270139180 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5270069530 con 0x7f527013eec0 2024-04-26T22:22:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52580071f0 con 0x7f527013eec0 2024-04-26T22:22:12.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f5266000640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 0x7f524c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f52580862d0 con 0x7f527013eec0 2024-04-26T22:22:12.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.274+0000 7f526de00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 0x7f524c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.278+0000 7f526de00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 0x7f524c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52600ae000 tx=0x7f52600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.278+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5258020020 con 0x7f527013eec0 2024-04-26T22:22:12.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.502+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f52700b2eb0 con 0x7f527013eec0 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.506+0000 7f5266000640 1 -- 172.21.15.16:0/199029508 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f52580561b0 con 0x7f527013eec0 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQChKCxmIPT0ARAAIv0bynjTbfZef5VoYTU1MQ== 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: caps mds = "allow" 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: caps mon = "allow r" 2024-04-26T22:22:12.511 INFO:teuthology.orchestra.run.smithi016.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:22:12.512 INFO:teuthology.orchestra.run.smithi016.stderr:updated caps for client.0 2024-04-26T22:22:12.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 msgr2=0x7f524c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 0x7f524c06a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f52600ae000 tx=0x7f52600a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 msgr2=0x7f527013fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f525800c500 tx=0x7f525800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 shutdown_connections 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f524c068380 0x7f524c06a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f52701465c0 0x7f5270141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f527013eec0 0x7f527013fed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 --2- 172.21.15.16:0/199029508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f527006e410 0x7f5270139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 >> 172.21.15.16:0/199029508 conn(0x7f52700b6590 msgr2=0x7f527014dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 shutdown_connections 2024-04-26T22:22:12.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.510+0000 7f5274c00640 1 -- 172.21.15.16:0/199029508 wait complete. 2024-04-26T22:22:12.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.670+0000 7f0b62c00640 1 Processor -- start 2024-04-26T22:22:12.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.670+0000 7f0b62c00640 1 -- start start 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b5c06e450 0x7f0b5c0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0b5c0b0ac0 0x7f0b5c1405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5c0b3310 con 0x7f0b5c06e450 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5c070790 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b62c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b3f50 con 0x7f0b5c0b58d0 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b5c06e450 0x7f0b5c0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b5c06e450 0x7f0b5c0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42968/0 (socket says 172.21.15.16:42968) 2024-04-26T22:22:12.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 -- 172.21.15.16:0/1188675119 learned_addr learned my addr 172.21.15.16:0/1188675119 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b53e00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b60c00640 1 --2- 172.21.15.16:0/1188675119 >> v2:172.21.15.195:3300/0 conn(0x7f0b5c0b0ac0 0x7f0b5c1405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 -- 172.21.15.16:0/1188675119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 msgr2=0x7f0b5c140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 -- 172.21.15.16:0/1188675119 >> v2:172.21.15.195:3300/0 conn(0x7f0b5c0b0ac0 msgr2=0x7f0b5c1405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 --2- 172.21.15.16:0/1188675119 >> v2:172.21.15.195:3300/0 conn(0x7f0b5c0b0ac0 0x7f0b5c1405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.674+0000 7f0b5be00640 1 -- 172.21.15.16:0/1188675119 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c06e830 con 0x7f0b5c06e450 2024-04-26T22:22:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b5be00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c06e450 0x7f0b5c0b3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14a8c0 tx=0x7f0b4c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b703cdeb597bd17e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b5b400640 1 -- 172.21.15.16:0/1188675119 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab620 con 0x7f0b5c06e450 2024-04-26T22:22:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b5b400640 1 -- 172.21.15.16:0/1188675119 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0b0070 con 0x7f0b5c06e450 2024-04-26T22:22:12.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b5b400640 1 -- 172.21.15.16:0/1188675119 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab9e0 con 0x7f0b5c06e450 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- 172.21.15.16:0/1188675119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c06e450 msgr2=0x7f0b5c0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c06e450 0x7f0b5c0b3a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14a8c0 tx=0x7f0b4c01c460 comp rx=0 tx=0).stop 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- 172.21.15.16:0/1188675119 shutdown_connections 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- 172.21.15.16:0/1188675119 >> v2:172.21.15.195:3300/0 conn(0x7f0b5c0b0ac0 0x7f0b5c1405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- 172.21.15.16:0/1188675119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c06e450 0x7f0b5c0b3a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- 172.21.15.16:0/1188675119 >> 172.21.15.16:0/1188675119 conn(0x7f0b5c0b6620 msgr2=0x7f0b5c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- 172.21.15.16:0/1188675119 shutdown_connections 2024-04-26T22:22:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- 172.21.15.16:0/1188675119 wait complete. 2024-04-26T22:22:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 Processor -- start 2024-04-26T22:22:12.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- start start 2024-04-26T22:22:12.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c06e450 0x7f0b5c072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c1e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b4eb0 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b4d30 con 0x7f0b5c06e450 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b62c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b5030 con 0x7f0b5c0b58d0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b53e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b53e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42984/0 (socket says 172.21.15.16:42984) 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b53e00640 1 -- 172.21.15.16:0/2152936385 learned_addr learned my addr 172.21.15.16:0/2152936385 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b60c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c1e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.678+0000 7f0b5be00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c06e450 0x7f0b5c072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 -- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 msgr2=0x7f0b5c1e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c1e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 -- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c06e450 msgr2=0x7f0b5c072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c06e450 0x7f0b5c072eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 -- 172.21.15.16:0/2152936385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c141d10 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b53e00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400d620 tx=0x7f0b4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400b620 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b44019070 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400b9e0 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c0b0550 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c073b50 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c069530 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b4400bb80 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 0x7f0b3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:12.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.682+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0b44086b70 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.686+0000 7f0b5be00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 0x7f0b3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:12.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.686+0000 7f0b5be00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 0x7f0b3806a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0af000 tx=0x7f0b4c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:12.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.686+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0b44056b70 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b5c06cb10 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b58c00640 1 -- 172.21.15.16:0/2152936385 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7f0b4405ae70 con 0x7f0b5c0b0ac0 2024-04-26T22:22:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:12.890 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:12.890 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 msgr2=0x7f0b3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 0x7f0b3806a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0af000 tx=0x7f0b4c0a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 msgr2=0x7f0b5c1e22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400d620 tx=0x7f0b4400dae0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 shutdown_connections 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f0b38068380 0x7f0b3806a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0b5c0b58d0 0x7f0b5c1e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b5c0b0ac0 0x7f0b5c1e22f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 --2- 172.21.15.16:0/2152936385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b5c06e450 0x7f0b5c072eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 >> 172.21.15.16:0/2152936385 conn(0x7f0b5c0b6620 msgr2=0x7f0b5c13fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 shutdown_connections 2024-04-26T22:22:12.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:12.886+0000 7f0b62c00640 1 -- 172.21.15.16:0/2152936385 wait complete. 2024-04-26T22:22:13.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:22:06.956001+0000', 'modified': '2024-04-26T22:22:09.969290+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4980}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4980': {'gid': 4980, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/3696570789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 3696570789}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 3696570789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4980, 'qdb_cluster': [4980]} 2024-04-26T22:22:13.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:22:13.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:22:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 Processor -- start 2024-04-26T22:22:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 -- start start 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdac073890 0x7fcdac0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b6dc0 0x7fcdac142650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdac073c70 con 0x7fcdac142b90 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcdac0b7250 con 0x7fcdac073890 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb4200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac0b7530 con 0x7fcdac0b6dc0 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdac073890 0x7fcdac0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdac073890 0x7fcdac0b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42994/0 (socket says 172.21.15.16:42994) 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 -- 172.21.15.16:0/591687318 learned_addr learned my addr 172.21.15.16:0/591687318 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b6dc0 0x7fcdac142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 -- 172.21.15.16:0/591687318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b6dc0 msgr2=0x7fcdac142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b6dc0 0x7fcdac142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 -- 172.21.15.16:0/591687318 >> v1:172.21.15.195:6789/0 conn(0x7fcdac142b90 legacy=0x7fcdac14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.250+0000 7fcdb1800640 1 -- 172.21.15.16:0/591687318 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac0b7ea0 con 0x7fcdac073890 2024-04-26T22:22:13.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb1800640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac073890 0x7fcdac0b7960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7762e6ae1eca33f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdabe00640 1 -- 172.21.15.16:0/591687318 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00b2070 con 0x7fcdac073890 2024-04-26T22:22:13.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdabe00640 1 -- 172.21.15.16:0/591687318 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda00a9070 con 0x7fcdac073890 2024-04-26T22:22:13.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdabe00640 1 -- 172.21.15.16:0/591687318 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00ad880 con 0x7fcdac073890 2024-04-26T22:22:13.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 -- 172.21.15.16:0/591687318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac073890 msgr2=0x7fcdac0b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac073890 0x7fcdac0b7960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda001c4d0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 -- 172.21.15.16:0/591687318 shutdown_connections 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac0b6dc0 0x7fcdac142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 --2- 172.21.15.16:0/591687318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac073890 0x7fcdac0b7960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 -- 172.21.15.16:0/591687318 >> 172.21.15.16:0/591687318 conn(0x7fcdac0b8850 msgr2=0x7fcdac0b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 -- 172.21.15.16:0/591687318 shutdown_connections 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.254+0000 7fcdb4200640 1 -- 172.21.15.16:0/591687318 wait complete. 2024-04-26T22:22:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 Processor -- start 2024-04-26T22:22:13.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- start start 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac073890 0x7fcdac140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac06cfa0 0x7fcdac13a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac155a60 con 0x7fcdac06cb80 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1558e0 con 0x7fcdac06cfa0 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac155be0 con 0x7fcdac073890 2024-04-26T22:22:13.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43004/0 (socket says 172.21.15.16:43004) 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2243893734 learned_addr learned my addr 172.21.15.16:0/2243893734 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac073890 0x7fcdac140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb2200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac06cfa0 0x7fcdac13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac073890 msgr2=0x7fcdac140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac073890 0x7fcdac140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac06cfa0 msgr2=0x7fcdac13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac06cfa0 0x7fcdac13a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2243893734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac141dd0 con 0x7fcdac06cb80 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d830 tx=0x7fcd9800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcda9600640 1 -- 172.21.15.16:0/2243893734 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800b6c0 con 0x7fcdac06cb80 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcda9600640 1 -- 172.21.15.16:0/2243893734 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd98019070 con 0x7fcdac06cb80 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcda9600640 1 -- 172.21.15.16:0/2243893734 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800ba60 con 0x7fcdac06cb80 2024-04-26T22:22:13.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac13b470 con 0x7fcdac06cb80 2024-04-26T22:22:13.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.258+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac06da10 con 0x7fcdac06cb80 2024-04-26T22:22:13.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcda9600640 1 -- 172.21.15.16:0/2243893734 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd9801e460 con 0x7fcdac06cb80 2024-04-26T22:22:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcda9600640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 0x7fcd8c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcda9600640 1 -- 172.21.15.16:0/2243893734 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcd98086fe0 con 0x7fcdac06cb80 2024-04-26T22:22:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 Processor -- start 2024-04-26T22:22:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 -- start start 2024-04-26T22:22:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 0x7fcd8c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7b7d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7ba78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e9f7a30140 con 0x55e9f7ba7e10 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e9f79c5e00 con 0x55e9f7ba74f0 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e9f797ea00 con 0x55e9f7ba9f80 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 0x7fcd8c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcda00af000 tx=0x7fcda00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43012/0 (socket says 172.21.15.16:43012) 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.262+0000 7fcdb2200640 1 -- 172.21.15.16:0/1157650044 learned_addr learned my addr 172.21.15.16:0/1157650044 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7ba78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb1800640 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7b7d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 -- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 msgr2=0x55e9f7b7d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7b7d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 -- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 msgr2=0x55e9f7ba78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7ba78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 -- 172.21.15.16:0/1157650044 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f79830e0 con 0x55e9f7ba7e10 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001ee0 tx=0x7fcda4001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d5672b9b7edf45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcd9e000640 1 -- 172.21.15.16:0/1157650044 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda400fe50 con 0x55e9f7ba7e10 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcd9e000640 1 -- 172.21.15.16:0/1157650044 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4018070 con 0x55e9f7ba7e10 2024-04-26T22:22:13.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcd9e000640 1 -- 172.21.15.16:0/1157650044 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4003b80 con 0x55e9f7ba7e10 2024-04-26T22:22:13.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- 172.21.15.16:0/1157650044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 msgr2=0x55e9f7ba81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcda4001ee0 tx=0x7fcda4001610 comp rx=0 tx=0).stop 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- 172.21.15.16:0/1157650044 shutdown_connections 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7ba81f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7ba78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/1157650044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7b7d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- 172.21.15.16:0/1157650044 >> 172.21.15.16:0/1157650044 conn(0x55e9f7b6f150 msgr2=0x55e9f7b7e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- 172.21.15.16:0/1157650044 shutdown_connections 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- 172.21.15.16:0/1157650044 wait complete. 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- start start 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 Processor -- start 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7b7bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba7e10 0x55e9f7b7c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e9f79d3200 con 0x55e9f7ba9f80 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e9f7969e80 con 0x55e9f7ba74f0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e9f79c0ae0 con 0x55e9f7ba7e10 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb77b9000 10 client.0 _ll_register_callbacks cb 0x55e9f79d2da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43026/0 (socket says 172.21.15.16:43026) 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 -- 172.21.15.16:0/421931440 learned_addr learned my addr 172.21.15.16:0/421931440 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba7e10 0x55e9f7b7c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb1800640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7b7bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 -- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba7e10 msgr2=0x55e9f7b7c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.266+0000 7fcdb2200640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba7e10 0x55e9f7b7c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb2200640 1 -- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 msgr2=0x55e9f7b7bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb2200640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7b7bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb2200640 1 -- 172.21.15.16:0/421931440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f79654e0 con 0x55e9f7ba9f80 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb2200640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcda40012f0 tx=0x7fcda4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5e379a9fb2ceb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40054e0 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda4018070 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcda4005680 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fcda402f050 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 10 client.5142 fetch_fsmap learned FSMap version 17 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e9f794be80 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4018070 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) ==== 2284+0+0 (secure 0 0 0) 0x7fcda4032020 con 0x55e9f7ba9f80 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 10 client.5142 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 10 client.5142 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 20 client.5142 populate_metadata read hostname 'smithi016' 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7b7d090 0x55e9f7bbeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 4 client.5142 mds_command: new command op to 4980 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:22:13.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 --> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9f795ebc0 con 0x55e9f7b7d090 2024-04-26T22:22:13.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb1800640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7b7d090 0x55e9f7bbeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb1800640 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7b7d090 0x55e9f7bbeb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4675a1e10fd83ce9 server_cookie=7aa099aba11135c0 in_seq=0 out_seq=0 2024-04-26T22:22:13.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 10 client.5142 ms_handle_connect on v2:172.21.15.16:6832/3696570789 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 1 -- 172.21.15.16:0/421931440 <== mds.0 v2:172.21.15.16:6832/3696570789 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9f795ebc0 con 0x55e9f7b7d090 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 10 client.5142 handle_command_reply: tid=0 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 client.5142 shutdown 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 msgr2=0x55e9f7b7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcda40012f0 tx=0x7fcda4001260 comp rx=0 tx=0).stop 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 shutdown_connections 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7b7d090 0x55e9f7bbeb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba9f80 0x55e9f7b7c680 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba7e10 0x55e9f7b7c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/421931440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba74f0 0x55e9f7b7bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcd92a00640 0 client.5142 ms_handle_reset on v2:172.21.15.16:6832/3696570789 2024-04-26T22:22:13.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 >> 172.21.15.16:0/421931440 conn(0x55e9f7b6f150 msgr2=0x55e9f7ba8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 shutdown_connections 2024-04-26T22:22:13.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 1 -- 172.21.15.16:0/421931440 wait complete. 2024-04-26T22:22:13.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.270+0000 7fcdb77b9000 20 client.5142 trim_cache size 0 max 16384 2024-04-26T22:22:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 Processor -- start 2024-04-26T22:22:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- start start 2024-04-26T22:22:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba7e10 0x55e9f7c1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7c1d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1ed7a0 con 0x55e9f7ba74f0 2024-04-26T22:22:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac1ec9a0 con 0x55e9f7ba7e10 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e9f795b7b0 con 0x55e9f7ba9f80 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43028/0 (socket says 172.21.15.16:43028) 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 -- 172.21.15.16:0/331149900 learned_addr learned my addr 172.21.15.16:0/331149900 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb2200640 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7c1d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba7e10 0x55e9f7c1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 -- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 msgr2=0x55e9f7c1d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7c1d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 -- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba7e10 msgr2=0x55e9f7c1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba7e10 0x55e9f7c1af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 -- 172.21.15.16:0/331149900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f797ec50 con 0x55e9f7ba74f0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb1800640 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcda001a100 tx=0x7fcda0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268148b2c99305e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcd9d600640 1 -- 172.21.15.16:0/331149900 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00b2040 con 0x55e9f7ba74f0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcd9d600640 1 -- 172.21.15.16:0/331149900 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda00d0070 con 0x55e9f7ba74f0 2024-04-26T22:22:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcd9d600640 1 -- 172.21.15.16:0/331149900 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00b9cb0 con 0x55e9f7ba74f0 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- 172.21.15.16:0/331149900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 msgr2=0x55e9f7c18a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcda001a100 tx=0x7fcda0004740 comp rx=0 tx=0).stop 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- 172.21.15.16:0/331149900 shutdown_connections 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba9f80 0x55e9f7c1d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba7e10 0x55e9f7c1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/331149900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba74f0 0x55e9f7c18a10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- 172.21.15.16:0/331149900 >> 172.21.15.16:0/331149900 conn(0x55e9f7b6f150 msgr2=0x55e9f7ba9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- 172.21.15.16:0/331149900 shutdown_connections 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.290+0000 7fcdb77b9000 1 -- 172.21.15.16:0/331149900 wait complete. 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- start start 2024-04-26T22:22:13.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 Processor -- start 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 0x55e9f7bec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 0x55e9f7becf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55e9f79ca430 con 0x55e9f7ba7e10 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x55e9f79c5110 con 0x55e9f7ba9f80 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x55e9f79d20a0 con 0x55e9f7ba74f0 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 10 client.0 _ll_register_callbacks cb 0x7fcd98056c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43030/0 (socket says 172.21.15.16:43030) 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2567773420 learned_addr learned my addr 172.21.15.16:0/2567773420 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 msgr2=0x55e9f7bec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb2200640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 0x55e9f7becf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 0x55e9f7bec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 0x55e9f7bec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 msgr2=0x55e9f7becf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 0x55e9f7becf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 -- 172.21.15.16:0/2567773420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f7a48160 con 0x55e9f7ba7e10 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb2200640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 0x55e9f7becf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 0x55e9f7bec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb0e00640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd98053310 tx=0x7fcd9805b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519f2d958c580809 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9806f130 con 0x55e9f7ba7e10 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcd9806f2d0 con 0x55e9f7ba7e10 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda00d0070 con 0x55e9f7ba7e10 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fcd98056300 con 0x55e9f7ba7e10 2024-04-26T22:22:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 10 client.5148 fetch_fsmap learned FSMap version 17 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55e9f767f0c0 con 0x55e9f7ba7e10 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda00d0070 con 0x55e9f7ba7e10 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) ==== 2284+0+0 (secure 0 0 0) 0x7fcd98013070 con 0x55e9f7ba7e10 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 10 client.5148 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 10 client.5148 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 20 client.5148 populate_metadata read hostname 'smithi016' 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7c21c70 0x55e9f7c24060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 4 client.5148 mds_command: new command op to 4980 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 --> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] -- command(tid 0: {"prefix": "status"}) -- 0x55e9f79d3a10 con 0x55e9f7c21c70 2024-04-26T22:22:13.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7c21c70 0x55e9f7c24060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb1800640 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7c21c70 0x55e9f7c24060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d7f17ff101ffb6 server_cookie=1c96d6117328486 in_seq=0 out_seq=0 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 10 client.5148 ms_handle_connect on v2:172.21.15.16:6832/3696570789 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 1 -- 172.21.15.16:0/2567773420 <== mds.0 v2:172.21.15.16:6832/3696570789 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55e9f79d3a10 con 0x55e9f7c21c70 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcd92a00640 10 client.5148 handle_command_reply: tid=0 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.294+0000 7fcdb77b9000 1 client.5148 shutdown 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 msgr2=0x55e9f7beca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcd98053310 tx=0x7fcd9805b2e0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 shutdown_connections 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:6832/3696570789,v1:172.21.15.16:6833/3696570789] conn(0x55e9f7c21c70 0x55e9f7c24060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9f7ba9f80 0x55e9f7becf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcd92a00640 0 client.5148 ms_handle_reset on v2:172.21.15.16:6832/3696570789 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55e9f7ba7e10 0x55e9f7beca20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 --2- 172.21.15.16:0/2567773420 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x55e9f7ba74f0 0x55e9f7bec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 >> 172.21.15.16:0/2567773420 conn(0x55e9f7b6f150 msgr2=0x55e9f7ba9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 shutdown_connections 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 1 -- 172.21.15.16:0/2567773420 wait complete. 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb77b9000 20 client.5148 trim_cache size 0 max 16384 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "53f352df-dd5a-41be-a68c-8728a38a6452", 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4980, 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-26T22:22:13.306 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 5.74820712, 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 17, 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 31, 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 31, 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 13.612310513000001 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 msgr2=0x7fcd8c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 0x7fcd8c06a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcda00af000 tx=0x7fcda00a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 msgr2=0x7fcdac139f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d830 tx=0x7fcd9800dcf0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 shutdown_connections 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcd8c068380 0x7fcd8c06a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac06cfa0 0x7fcdac13a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdac06cb80 0x7fcdac139f50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 --2- 172.21.15.16:0/2243893734 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcdac073890 0x7fcdac140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 >> 172.21.15.16:0/2243893734 conn(0x7fcdac0b8850 msgr2=0x7fcdac06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 shutdown_connections 2024-04-26T22:22:13.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.298+0000 7fcdb4200640 1 -- 172.21.15.16:0/2243893734 wait complete. 2024-04-26T22:22:13.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:22:13.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 Processor -- start 2024-04-26T22:22:13.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 -- start start 2024-04-26T22:22:13.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f56d806d1d0 0x7f56d80b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56d8142490 0x7f56d8142900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d80b73e0 con 0x7f56d80b7000 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f56d80b6c00 con 0x7f56d8142490 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56dda00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f56d80b7750 con 0x7f56d806d1d0 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56d8142490 0x7f56d8142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56d8142490 0x7f56d8142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43040/0 (socket says 172.21.15.16:43040) 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 -- 172.21.15.16:0/2028349410 learned_addr learned my addr 172.21.15.16:0/2028349410 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56ce000640 1 --2- 172.21.15.16:0/2028349410 >> v2:172.21.15.195:3300/0 conn(0x7f56d806d1d0 0x7f56d80b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 -- 172.21.15.16:0/2028349410 >> v2:172.21.15.195:3300/0 conn(0x7f56d806d1d0 msgr2=0x7f56d80b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 --2- 172.21.15.16:0/2028349410 >> v2:172.21.15.195:3300/0 conn(0x7f56d806d1d0 0x7f56d80b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 -- 172.21.15.16:0/2028349410 >> v1:172.21.15.195:6789/0 conn(0x7f56d80b7000 legacy=0x7f56d80b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.458+0000 7f56d7400640 1 -- 172.21.15.16:0/2028349410 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d80b7ab0 con 0x7f56d8142490 2024-04-26T22:22:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56d7400640 1 --2- 172.21.15.16:0/2028349410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d8142490 0x7f56d8142900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56d81461b0 tx=0x7f56d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cad45d834d5c237 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56d6000640 1 -- 172.21.15.16:0/2028349410 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d00b0070 con 0x7f56d8142490 2024-04-26T22:22:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56d6000640 1 -- 172.21.15.16:0/2028349410 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d00ab600 con 0x7f56d8142490 2024-04-26T22:22:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56d6000640 1 -- 172.21.15.16:0/2028349410 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d00ab9d0 con 0x7f56d8142490 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- 172.21.15.16:0/2028349410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d8142490 msgr2=0x7f56d8142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 --2- 172.21.15.16:0/2028349410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d8142490 0x7f56d8142900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56d81461b0 tx=0x7f56d001c520 comp rx=0 tx=0).stop 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- 172.21.15.16:0/2028349410 shutdown_connections 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 --2- 172.21.15.16:0/2028349410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d8142490 0x7f56d8142900 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 --2- 172.21.15.16:0/2028349410 >> v2:172.21.15.195:3300/0 conn(0x7f56d806d1d0 0x7f56d80b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- 172.21.15.16:0/2028349410 >> 172.21.15.16:0/2028349410 conn(0x7f56d806f3d0 msgr2=0x7f56d806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- 172.21.15.16:0/2028349410 shutdown_connections 2024-04-26T22:22:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- 172.21.15.16:0/2028349410 wait complete. 2024-04-26T22:22:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 Processor -- start 2024-04-26T22:22:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.462+0000 7f56dda00640 1 -- start start 2024-04-26T22:22:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56d80b7000 0x7f56d81e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d8142490 0x7f56d80bab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81559d0 con 0x7f56d806d1d0 2024-04-26T22:22:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f56d8155850 con 0x7f56d8142490 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f56d8155b50 con 0x7f56d80b7000 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43050/0 (socket says 172.21.15.16:43050) 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 -- 172.21.15.16:0/4055911652 learned_addr learned my addr 172.21.15.16:0/4055911652 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56ce000640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56d80b7000 0x7f56d81e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d7400640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d8142490 0x7f56d80bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 -- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56d80b7000 msgr2=0x7f56d81e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56d80b7000 0x7f56d81e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 -- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d8142490 msgr2=0x7f56d80bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d8142490 0x7f56d80bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 -- 172.21.15.16:0/4055911652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d81e5130 con 0x7f56d806d1d0 2024-04-26T22:22:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56d6a00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c770 tx=0x7f56c800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003ba0 con 0x7f56d806d1d0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8003d60 con 0x7f56d806d1d0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c800aa90 con 0x7f56d806d1d0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d81476e0 con 0x7f56d806d1d0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d81e46d0 con 0x7f56d806d1d0 2024-04-26T22:22:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.466+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d8147a20 con 0x7f56d806d1d0 2024-04-26T22:22:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.470+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f56c800ac30 con 0x7f56d806d1d0 2024-04-26T22:22:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.470+0000 7f56cf400640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 0x7f56b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.470+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f56c8086790 con 0x7f56d806d1d0 2024-04-26T22:22:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.470+0000 7f56ce000640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 0x7f56b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.470+0000 7f56ce000640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 0x7f56b406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56d813a5a0 tx=0x7f56c0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.474+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f56d8147a20 con 0x7f56d806d1d0 2024-04-26T22:22:13.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56d8069530 con 0x7f56d806d1d0 2024-04-26T22:22:13.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56cf400640 1 -- 172.21.15.16:0/4055911652 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f56c80566f0 con 0x7f56d806d1d0 2024-04-26T22:22:13.682 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 msgr2=0x7f56b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 0x7f56b406a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f56d813a5a0 tx=0x7f56c0009190 comp rx=0 tx=0).stop 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 msgr2=0x7f56d81459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c770 tx=0x7f56c800cc30 comp rx=0 tx=0).stop 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 shutdown_connections 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f56b4068380 0x7f56b406a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56d8142490 0x7f56d80bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56d80b7000 0x7f56d81e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 --2- 172.21.15.16:0/4055911652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56d806d1d0 0x7f56d81459b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:13.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 >> 172.21.15.16:0/4055911652 conn(0x7f56d806f3d0 msgr2=0x7f56d813d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:13.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 shutdown_connections 2024-04-26T22:22:13.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13.678+0000 7f56dda00640 1 -- 172.21.15.16:0/4055911652 wait complete. 2024-04-26T22:22:13.703 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:22:13.704 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:22:13.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:13.705 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-26T22:22:13.714 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:22:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:22:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:22:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42390sec preferred_lft 42390sec 2024-04-26T22:22:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:d9:94:62:67 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T22:22:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.717 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:22:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T22:22:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:22:13.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:13.717 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:22:13.778 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-26T22:22:13.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:13.780 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T22:22:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:22:13.834 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:22:13.835 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-26T22:22:13.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T22:22:13.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T22:22:13.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T22:22:13.835 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-26T22:22:13.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:22:13.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:22:13.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:13.973 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T22:22:13.981 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:22:13.982 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:22:13.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:13.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-26T22:22:14.048 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T22:22:14.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:22:14.048 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:14.096 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:22:14.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:22:14.097 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:14.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T22:22:14.217 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T22:22:14.269 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T22:22:14.270 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:14.271 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:14.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:14.272 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T22:22:14.328 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T22:22:14.328 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T22:22:14.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-26T22:22:14.391 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T22:22:14.441 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-26T22:22:14.442 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:14.443 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:14.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:14.444 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-26T22:22:14.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:2024-04-26T22:22:14.462+0000 7fe134364580 -1 init, newargv = 0x560668bcb540 newargc=15 2024-04-26T22:22:14.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[35493]: starting ceph client 2024-04-26T22:22:14.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[35493]: starting fuse 2024-04-26T22:22:14.476 INFO:teuthology.orchestra.run.smithi016.stdout:44 2024-04-26T22:22:14.476 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo stdin-killer -- python3 -c ' 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> import glob 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> import re 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> import os 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> import subprocess 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> def _find_admin_socket(client_name): 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> files = glob.glob(asok_path) 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> # Given a non-glob path, it better be there 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> if "*" not in asok_path: 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> assert(len(files) == 1) 2024-04-26T22:22:14.477 DEBUG:teuthology.orchestra.run.smithi016:> return files[0] 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> for f in files: 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> contents = proc_f.read() 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> if mountpoint in contents: 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> return f 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> print(_find_admin_socket("client.0")) 2024-04-26T22:22:14.478 DEBUG:teuthology.orchestra.run.smithi016:> ' 2024-04-26T22:22:14.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:22:14.587 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:22:14.609 INFO:teuthology.orchestra.run.smithi016.stdout:/var/run/ceph/ceph-client.0.35493.asok 2024-04-26T22:22:14.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:22:14.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35493.asok 2024-04-26T22:22:14.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:14.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35493.asok status 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "metadata": { 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "entity_id": "0", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": "smithi016", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "pid": "35493", 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "root": "/" 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:14.807 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_count": 0, 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_pinned_count": 0, 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 5160, 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "inst": { 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "name": { 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "client", 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "num": 5160 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 187608353 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-26T22:22:14.808 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 187608353 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "inst_str": "client.5160 192.168.0.1:0/187608353", 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "addr_str": "192.168.0.1:0/187608353", 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "inode_count": 1, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_epoch": 17, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch": 31, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch_barrier": 0, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "blocklisted": false, 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs" 2024-04-26T22:22:14.809 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:14.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:14.822 DEBUG:teuthology.orchestra.run.smithi016:> stat --file-system '--printf=%T 2024-04-26T22:22:14.822 DEBUG:teuthology.orchestra.run.smithi016:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:14.831 INFO:teuthology.orchestra.run.smithi016.stdout:fuseblk 2024-04-26T22:22:14.832 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:14.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:14.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:14.892 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T22:22:14.944 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.vMQmSSCK8b 2024-04-26T22:22:14.944 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:22:14.944 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/tmp/tmp.vMQmSSCK8b 2024-04-26T22:22:14.992 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir1/dir2/dir3') 2024-04-26T22:22:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:22:15.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:22:15.122 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'chmod 755 /tmp/test-cephfs_1b1iq2h') 2024-04-26T22:22:15.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:22:15.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:22:15.183 INFO:tasks.cephfs.test_cephfs_shell:Running script "/tmp/test-cephfs_1b1iq2h" 2024-04-26T22:22:15.183 DEBUG:teuthology.orchestra.run.smithi016:> cephfs-shell -b /tmp/test-cephfs_1b1iq2h 2024-04-26T22:22:15.469 INFO:teuthology.orchestra.run.smithi016.stderr:Unrecognized command 2024-04-26T22:22:15.494 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-04-26T22:22:15.494 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:22:15.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:22:15.595 DEBUG:teuthology.orchestra.run.smithi195:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:22:15.684 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:22:15.684 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:22:15.684 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:22:15.685 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:22:15.694 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:22:15.694 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:22:15.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.922+0000 7fc767200640 1 Processor -- start 2024-04-26T22:22:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.922+0000 7fc767200640 1 -- start start 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc767200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc7680b6540 0x7fc7680bab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc767200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7680bb2b0 con 0x7fc768148760 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc767200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7680b5190 con 0x7fc7681482b0 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc767200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc7680bb090 con 0x7fc7680b6540 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc765e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc7680b6540 0x7fc7680bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc766800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc768148760 0x7fc768152c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47794/0 (socket says 172.21.15.16:47794) 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc766800640 1 -- 172.21.15.16:0/3434575355 learned_addr learned my addr 172.21.15.16:0/3434575355 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc765e00640 1 -- 172.21.15.16:0/3434575355 >> v1:172.21.15.195:6789/0 conn(0x7fc7681482b0 legacy=0x7fc768141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc765e00640 1 -- 172.21.15.16:0/3434575355 >> v1:172.21.15.16:6789/0 conn(0x7fc768148760 legacy=0x7fc768152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.926+0000 7fc765e00640 1 -- 172.21.15.16:0/3434575355 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7680b6920 con 0x7fc7680b6540 2024-04-26T22:22:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765e00640 1 --2- 172.21.15.16:0/3434575355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc7680bab50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc7580097c0 tx=0x7fc75801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5115c1e5128394f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765400640 1 -- 172.21.15.16:0/3434575355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580b0070 con 0x7fc7680b6540 2024-04-26T22:22:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765400640 1 -- 172.21.15.16:0/3434575355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7580ab600 con 0x7fc7680b6540 2024-04-26T22:22:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765400640 1 -- 172.21.15.16:0/3434575355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580ab9d0 con 0x7fc7680b6540 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- 172.21.15.16:0/3434575355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 msgr2=0x7fc7680bab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 --2- 172.21.15.16:0/3434575355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc7680bab50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc7580097c0 tx=0x7fc75801c380 comp rx=0 tx=0).stop 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- 172.21.15.16:0/3434575355 shutdown_connections 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 --2- 172.21.15.16:0/3434575355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc7680bab50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- 172.21.15.16:0/3434575355 >> 172.21.15.16:0/3434575355 conn(0x7fc768068540 msgr2=0x7fc768068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- 172.21.15.16:0/3434575355 shutdown_connections 2024-04-26T22:22:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- 172.21.15.16:0/3434575355 wait complete. 2024-04-26T22:22:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 Processor -- start 2024-04-26T22:22:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- start start 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 0x7fc768140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc768148760 0x7fc768140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc768156cf0 con 0x7fc7680b6540 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc768156b70 con 0x7fc7681482b0 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc767200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc768156e70 con 0x7fc768148760 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57104/0 (socket says 172.21.15.16:57104) 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.930+0000 7fc765e00640 1 -- 172.21.15.16:0/3068020491 learned_addr learned my addr 172.21.15.16:0/3068020491 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75fe00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 0x7fc768140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc766800640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc768148760 0x7fc768140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 -- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc768148760 msgr2=0x7fc768140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc768148760 0x7fc768140c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 -- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 msgr2=0x7fc768140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:15.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 0x7fc768140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:15.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 -- 172.21.15.16:0/3068020491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7681e18b0 con 0x7fc7680b6540 2024-04-26T22:22:15.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75fe00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 0x7fc768140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc765e00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7580ae040 tx=0x7fc75801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580b0050 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7580bc070 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580b5a50 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc768144340 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7681e1b70 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7680507b0 con 0x7fc7680b6540 2024-04-26T22:22:15.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7580ab4a0 con 0x7fc7680b6540 2024-04-26T22:22:15.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 0x7fc74406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:15.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.934+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc758121280 con 0x7fc7680b6540 2024-04-26T22:22:15.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.938+0000 7fc75fe00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 0x7fc74406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:15.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.938+0000 7fc75fe00640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 0x7fc74406a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7680bdfe0 tx=0x7fc750009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:15.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:15.938+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc758016090 con 0x7fc7680b6540 2024-04-26T22:22:16.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.106+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7680bcd00 con 0x7fc7680b6540 2024-04-26T22:22:16.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.106+0000 7fc75e000640 1 -- 172.21.15.16:0/3068020491 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16657 (secure 0 0 0) 0x7fc7580f1830 con 0x7fc7680b6540 2024-04-26T22:22:16.111 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:16.111 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:08.552305+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 msgr2=0x7fc74406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 0x7fc74406a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc7680bdfe0 tx=0x7fc750009040 comp rx=0 tx=0).stop 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 msgr2=0x7fc768142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc7580ae040 tx=0x7fc75801abc0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 shutdown_connections 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc744068380 0x7fc74406a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc768148760 0x7fc768140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7681482b0 0x7fc768140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 --2- 172.21.15.16:0/3068020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7680b6540 0x7fc768142e00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 >> 172.21.15.16:0/3068020491 conn(0x7fc768068540 msgr2=0x7fc7680bc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 shutdown_connections 2024-04-26T22:22:16.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.110+0000 7fc767200640 1 -- 172.21.15.16:0/3068020491 wait complete. 2024-04-26T22:22:16.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:22:04.803346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:22:05.921975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:22:16.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:22:16.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 Processor -- start 2024-04-26T22:22:16.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 -- start start 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a64073860 0x7f3a64142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a640a12d0 con 0x7f3a64142980 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a640b6ed0 con 0x7f3a640b7880 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a6be00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3a640b7210 con 0x7f3a64073860 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a64073860 0x7f3a64142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3a64142980 0x7f3a64152df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47806/0 (socket says 172.21.15.16:47806) 2024-04-26T22:22:16.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69e00640 1 -- 172.21.15.16:0/1889980565 learned_addr learned my addr 172.21.15.16:0/1889980565 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:16.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69400640 1 -- 172.21.15.16:0/1889980565 >> v1:172.21.15.195:6789/0 conn(0x7f3a640b7880 legacy=0x7f3a64070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69400640 1 -- 172.21.15.16:0/1889980565 >> v1:172.21.15.16:6789/0 conn(0x7f3a64142980 legacy=0x7f3a64152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a69400640 1 -- 172.21.15.16:0/1889980565 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a64073c40 con 0x7f3a64073860 2024-04-26T22:22:16.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.274+0000 7f3a63e00640 1 -- 172.21.15.16:0/1889980565 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177680506 0 0) 0x7f3a640a12d0 con 0x7f3a64142980 2024-04-26T22:22:16.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a69400640 1 --2- 172.21.15.16:0/1889980565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a64073860 0x7f3a64142440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a580097c0 tx=0x7f3a5801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b871d4bd934dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a63e00640 1 -- 172.21.15.16:0/1889980565 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b0070 con 0x7f3a64073860 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a63e00640 1 -- 172.21.15.16:0/1889980565 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a580ab600 con 0x7f3a64073860 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a63e00640 1 -- 172.21.15.16:0/1889980565 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580ab9d0 con 0x7f3a64073860 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 -- 172.21.15.16:0/1889980565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a64073860 msgr2=0x7f3a64142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 --2- 172.21.15.16:0/1889980565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a64073860 0x7f3a64142440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a580097c0 tx=0x7f3a5801c340 comp rx=0 tx=0).stop 2024-04-26T22:22:16.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 -- 172.21.15.16:0/1889980565 shutdown_connections 2024-04-26T22:22:16.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 --2- 172.21.15.16:0/1889980565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a64073860 0x7f3a64142440 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 -- 172.21.15.16:0/1889980565 >> 172.21.15.16:0/1889980565 conn(0x7f3a640b8850 msgr2=0x7f3a640b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 -- 172.21.15.16:0/1889980565 shutdown_connections 2024-04-26T22:22:16.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.278+0000 7f3a6be00640 1 -- 172.21.15.16:0/1889980565 wait complete. 2024-04-26T22:22:16.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 Processor -- start 2024-04-26T22:22:16.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- start start 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 0x7f3a64145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a64142980 0x7f3a64142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3a640708a0 con 0x7f3a641433c0 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64070720 con 0x7f3a64073860 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3a64156d30 con 0x7f3a64142980 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57128/0 (socket says 172.21.15.16:57128) 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 -- 172.21.15.16:0/532501428 learned_addr learned my addr 172.21.15.16:0/532501428 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69400640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 0x7f3a64145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a68a00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a64142980 0x7f3a64142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 -- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a64142980 msgr2=0x7f3a64142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a64142980 0x7f3a64142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 -- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 msgr2=0x7f3a64145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 0x7f3a64145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 -- 172.21.15.16:0/532501428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a640b1760 con 0x7f3a641433c0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69400640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 0x7f3a64145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a69e00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00cb20 tx=0x7f3a5c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00ac00 con 0x7f3a641433c0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00adc0 con 0x7f3a641433c0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a640b2b30 con 0x7f3a641433c0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c012640 con 0x7f3a641433c0 2024-04-26T22:22:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a64145ff0 con 0x7f3a641433c0 2024-04-26T22:22:16.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.282+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a64069530 con 0x7f3a641433c0 2024-04-26T22:22:16.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.286+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a5c0127e0 con 0x7f3a641433c0 2024-04-26T22:22:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.286+0000 7f3a61600640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 0x7f3a4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.286+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3a5c086f70 con 0x7f3a641433c0 2024-04-26T22:22:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.286+0000 7f3a69400640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 0x7f3a4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.286+0000 7f3a69400640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 0x7f3a4406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a580ad000 tx=0x7f3a580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.290+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3a640b2b30 con 0x7f3a641433c0 2024-04-26T22:22:16.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.454+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a640bb020 con 0x7f3a641433c0 2024-04-26T22:22:16.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.454+0000 7f3a61600640 1 -- 172.21.15.16:0/532501428 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7f3a5c057520 con 0x7f3a641433c0 2024-04-26T22:22:16.460 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:22:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 msgr2=0x7f3a4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 0x7f3a4406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a580ad000 tx=0x7f3a580a6000 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 msgr2=0x7f3a64143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00cb20 tx=0x7f3a5c0021d0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 shutdown_connections 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3a44068380 0x7f3a4406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a641433c0 0x7f3a64143d60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a64142980 0x7f3a64142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 --2- 172.21.15.16:0/532501428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a64073860 0x7f3a64145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 >> 172.21.15.16:0/532501428 conn(0x7f3a640b8850 msgr2=0x7f3a6406cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 shutdown_connections 2024-04-26T22:22:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.458+0000 7f3a6be00640 1 -- 172.21.15.16:0/532501428 wait complete. 2024-04-26T22:22:16.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:22:16.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 Processor -- start 2024-04-26T22:22:16.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 -- start start 2024-04-26T22:22:16.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5d941465c0 0x7f5d940b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d9413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9406e7f0 con 0x7f5d9406e410 2024-04-26T22:22:16.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5d94070a40 con 0x7f5d941465c0 2024-04-26T22:22:16.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d9a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5d94070760 con 0x7f5d9413eec0 2024-04-26T22:22:16.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d93400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5d9406e410 0x7f5d94149060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47810/0 (socket says 172.21.15.16:47810) 2024-04-26T22:22:16.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d93400640 1 -- 172.21.15.16:0/676486315 learned_addr learned my addr 172.21.15.16:0/676486315 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/676486315 >> v2:172.21.15.195:3300/0 conn(0x7f5d941465c0 0x7f5d940b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d93e00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d9413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048096089 0 0) 0x7f5d9406e7f0 con 0x7f5d9406e410 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d78005740 con 0x7f5d9406e410 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3210049438 0 0) 0x7f5d78005740 con 0x7f5d9406e410 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 msgr2=0x7f5d9413f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d9413f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 >> v2:172.21.15.195:3300/0 conn(0x7f5d941465c0 msgr2=0x7f5d940b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 --2- 172.21.15.16:0/676486315 >> v2:172.21.15.195:3300/0 conn(0x7f5d941465c0 0x7f5d940b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d94148860 con 0x7f5d9406e410 2024-04-26T22:22:16.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f5d84001680 con 0x7f5d9406e410 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 >> v1:172.21.15.16:6789/0 conn(0x7f5d9406e410 legacy=0x7f5d94149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d78005bd0 0x7f5d78005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78006a20 0x7f5d78006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d780073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94070a40 con 0x7f5d78006a20 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5d94070760 con 0x7f5d78005bd0 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7800dbe0 con 0x7f5d9413eec0 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78006a20 0x7f5d78006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d93400640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d78005bd0 0x7f5d78005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d93e00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d780073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 -- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 msgr2=0x7f5d780073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d9413eec0 0x7f5d780073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 -- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d78005bd0 msgr2=0x7f5d78005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d78005bd0 0x7f5d78005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.622+0000 7f5d8aa00640 1 -- 172.21.15.16:0/676486315 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d78005740 con 0x7f5d78006a20 2024-04-26T22:22:16.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78006a20 0x7f5d78006ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009b10 tx=0x7f5d7c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5478e7fb49aa1e72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0096b0 con 0x7f5d78006a20 2024-04-26T22:22:16.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0a8420 con 0x7f5d78006a20 2024-04-26T22:22:16.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d92a00640 1 -- 172.21.15.16:0/676486315 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9413f8c0 con 0x7f5d78006a20 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 -- 172.21.15.16:0/676486315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78006a20 msgr2=0x7f5d78006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 --2- 172.21.15.16:0/676486315 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78006a20 0x7f5d78006ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009b10 tx=0x7f5d7c01cab0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d93e00640 1 -- 172.21.15.16:0/676486315 reap_dead start 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 -- 172.21.15.16:0/676486315 shutdown_connections 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 -- 172.21.15.16:0/676486315 >> 172.21.15.16:0/676486315 conn(0x7f5d940b6590 msgr2=0x7f5d940b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 -- 172.21.15.16:0/676486315 shutdown_connections 2024-04-26T22:22:16.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.626+0000 7f5d9a000640 1 -- 172.21.15.16:0/676486315 wait complete. 2024-04-26T22:22:16.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 Processor -- start 2024-04-26T22:22:16.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- start start 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 0x7f5d941414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d94142270 0x7f5d941dcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940b5030 con 0x7f5d941426d0 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940b4eb0 con 0x7f5d94142270 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5d940b51b0 con 0x7f5d78006a20 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57152/0 (socket says 172.21.15.16:57152) 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 -- 172.21.15.16:0/3113964075 learned_addr learned my addr 172.21.15.16:0/3113964075 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d8aa00640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d94142270 0x7f5d941dcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93400640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 0x7f5d941414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 -- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 msgr2=0x7f5d941414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 0x7f5d941414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 -- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d94142270 msgr2=0x7f5d941dcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d94142270 0x7f5d941dcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 -- 172.21.15.16:0/3113964075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d940711b0 con 0x7f5d941426d0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93400640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 0x7f5d941414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d93e00640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d940b7330 tx=0x7f5d8c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c019070 con 0x7f5d941426d0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c00fdb0 con 0x7f5d941426d0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c003be0 con 0x7f5d941426d0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d94071490 con 0x7f5d941426d0 2024-04-26T22:22:16.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.630+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d94142000 con 0x7f5d941426d0 2024-04-26T22:22:16.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d94145e50 con 0x7f5d941426d0 2024-04-26T22:22:16.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d8c01c070 con 0x7f5d941426d0 2024-04-26T22:22:16.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d8be00640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 0x7f5d7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5d8c087210 con 0x7f5d941426d0 2024-04-26T22:22:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d93400640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 0x7f5d7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.634+0000 7f5d93400640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 0x7f5d7006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001680 tx=0x7f5d84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.638+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d94145e50 con 0x7f5d941426d0 2024-04-26T22:22:16.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.802+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5d941dc880 con 0x7f5d941426d0 2024-04-26T22:22:16.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.802+0000 7f5d8be00640 1 -- 172.21.15.16:0/3113964075 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f5d941dc880 con 0x7f5d941426d0 2024-04-26T22:22:16.807 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:22:16.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 msgr2=0x7f5d7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 0x7f5d7006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001680 tx=0x7f5d84009040 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 msgr2=0x7f5d941dd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d940b7330 tx=0x7f5d8c00f580 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 shutdown_connections 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5d70068380 0x7f5d7006a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d941426d0 0x7f5d941dd0e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5d94142270 0x7f5d941dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 --2- 172.21.15.16:0/3113964075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5d78006a20 0x7f5d941414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 >> 172.21.15.16:0/3113964075 conn(0x7f5d940b6590 msgr2=0x7f5d940b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 shutdown_connections 2024-04-26T22:22:16.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.806+0000 7f5d9a000640 1 -- 172.21.15.16:0/3113964075 wait complete. 2024-04-26T22:22:16.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:22:16.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 Processor -- start 2024-04-26T22:22:16.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 -- start start 2024-04-26T22:22:16.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f167c06e410 0x7f167c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167c070480 con 0x7f167c0b0a30 2024-04-26T22:22:16.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f167c070a60 con 0x7f167c06e410 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1680c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f167c0718a0 con 0x7f167c146bf0 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f167c06e410 0x7f167c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f167c06e410 0x7f167c13ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57160/0 (socket says 172.21.15.16:57160) 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 -- 172.21.15.16:0/752051139 learned_addr learned my addr 172.21.15.16:0/752051139 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f167a800640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 -- 172.21.15.16:0/752051139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 msgr2=0x7f167c140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:16.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 -- 172.21.15.16:0/752051139 >> v1:172.21.15.16:6789/0 conn(0x7f167c0b0a30 legacy=0x7f167c1464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f1679e00640 1 -- 172.21.15.16:0/752051139 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c06e7f0 con 0x7f167c06e410 2024-04-26T22:22:16.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.970+0000 7f167a800640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:16.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1679e00640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c13ffd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f470a0b04b570c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1678a00640 1 -- 172.21.15.16:0/752051139 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c0aa620 con 0x7f167c06e410 2024-04-26T22:22:16.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1678a00640 1 -- 172.21.15.16:0/752051139 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c0af070 con 0x7f167c06e410 2024-04-26T22:22:16.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1678a00640 1 -- 172.21.15.16:0/752051139 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c0aa9e0 con 0x7f167c06e410 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- 172.21.15.16:0/752051139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 msgr2=0x7f167c13ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c13ffd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c01c4a0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- 172.21.15.16:0/752051139 shutdown_connections 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 --2- 172.21.15.16:0/752051139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c13ffd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- 172.21.15.16:0/752051139 >> 172.21.15.16:0/752051139 conn(0x7f167c0b6590 msgr2=0x7f167c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- 172.21.15.16:0/752051139 shutdown_connections 2024-04-26T22:22:16.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- 172.21.15.16:0/752051139 wait complete. 2024-04-26T22:22:16.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 Processor -- start 2024-04-26T22:22:16.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.974+0000 7f1680c00640 1 -- start start 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 0x7f167c1e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c13ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f167c153520 con 0x7f167c06e410 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f167c1533a0 con 0x7f167c0b0a30 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f167c1536a0 con 0x7f167c146bf0 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57172/0 (socket says 172.21.15.16:57172) 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 -- 172.21.15.16:0/3463380472 learned_addr learned my addr 172.21.15.16:0/3463380472 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679400640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 0x7f167c1e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f167a800640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c13ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 -- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 msgr2=0x7f167c13ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c13ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 -- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 msgr2=0x7f167c1e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 0x7f167c1e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 -- 172.21.15.16:0/3463380472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c14a680 con 0x7f167c06e410 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679400640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 0x7f167c1e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:16.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f167a800640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c13ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1679e00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ac040 tx=0x7f166c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c0bd3f0 con 0x7f167c06e410 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c0bd590 con 0x7f167c06e410 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c0bd980 con 0x7f167c06e410 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c149b80 con 0x7f167c06e410 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c13ead0 con 0x7f167c06e410 2024-04-26T22:22:16.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167c069530 con 0x7f167c06e410 2024-04-26T22:22:16.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.978+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f166c0c63f0 con 0x7f167c06e410 2024-04-26T22:22:16.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.982+0000 7f1672000640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 0x7f165c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:16.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.982+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f166c121150 con 0x7f167c06e410 2024-04-26T22:22:16.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.982+0000 7f1679400640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 0x7f165c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:16.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.982+0000 7f1679400640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 0x7f165c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f167c14a8b0 tx=0x7f1668009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:16.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:16.986+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f166c016150 con 0x7f167c06e410 2024-04-26T22:22:17.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f167c13fa60 con 0x7f167c06e410 2024-04-26T22:22:17.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1672000640 1 -- 172.21.15.16:0/3463380472 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7f166c0f1700 con 0x7f167c06e410 2024-04-26T22:22:17.155 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:22:17.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 msgr2=0x7f165c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 0x7f165c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f167c14a8b0 tx=0x7f1668009040 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 msgr2=0x7f167c073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f166c0ac040 tx=0x7f166c01ace0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 shutdown_connections 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f165c068380 0x7f165c06a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f167c146bf0 0x7f167c13ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f167c0b0a30 0x7f167c1e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 --2- 172.21.15.16:0/3463380472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f167c06e410 0x7f167c073b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 >> 172.21.15.16:0/3463380472 conn(0x7f167c0b6590 msgr2=0x7f167c13bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 shutdown_connections 2024-04-26T22:22:17.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.150+0000 7f1680c00640 1 -- 172.21.15.16:0/3463380472 wait complete. 2024-04-26T22:22:17.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:22:17.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 Processor -- start 2024-04-26T22:22:17.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 -- start start 2024-04-26T22:22:17.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 0x7f7d081400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d080b7880 con 0x7f7d08149a30 2024-04-26T22:22:17.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d080b7b60 con 0x7f7d080b90f0 2024-04-26T22:22:17.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d0da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7d080b12a0 con 0x7f7d080b64e0 2024-04-26T22:22:17.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d06a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7d08149a30 0x7f7d08149e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47826/0 (socket says 172.21.15.16:47826) 2024-04-26T22:22:17.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d06a00640 1 -- 172.21.15.16:0/4275517129 learned_addr learned my addr 172.21.15.16:0/4275517129 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:17.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7cffe00640 1 --2- 172.21.15.16:0/4275517129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 0x7f7d081400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782970778 0 0) 0x7f7d080b7880 con 0x7f7d08149a30 2024-04-26T22:22:17.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cec003530 con 0x7f7d08149a30 2024-04-26T22:22:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614229853 0 0) 0x7f7d080b7b60 con 0x7f7d080b90f0 2024-04-26T22:22:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7cffe00640 1 -- 172.21.15.16:0/4275517129 >> v1:172.21.15.195:6789/0 conn(0x7f7d080b90f0 legacy=0x7f7d08150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7cffe00640 1 -- 172.21.15.16:0/4275517129 >> v1:172.21.15.16:6789/0 conn(0x7f7d08149a30 legacy=0x7f7d08149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.314+0000 7f7cffe00640 1 -- 172.21.15.16:0/4275517129 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d080b6f90 con 0x7f7d080b64e0 2024-04-26T22:22:17.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7cffe00640 1 --2- 172.21.15.16:0/4275517129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 0x7f7d081400e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097f0 tx=0x7f7cf001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed546d96ce8183d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00b0070 con 0x7f7d080b64e0 2024-04-26T22:22:17.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf00ab600 con 0x7f7d080b64e0 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d06000640 1 -- 172.21.15.16:0/4275517129 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00ab9d0 con 0x7f7d080b64e0 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 -- 172.21.15.16:0/4275517129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 msgr2=0x7f7d081400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 --2- 172.21.15.16:0/4275517129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 0x7f7d081400e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097f0 tx=0x7f7cf001c450 comp rx=0 tx=0).stop 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 -- 172.21.15.16:0/4275517129 shutdown_connections 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 --2- 172.21.15.16:0/4275517129 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b64e0 0x7f7d081400e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 -- 172.21.15.16:0/4275517129 >> 172.21.15.16:0/4275517129 conn(0x7f7d080b8600 msgr2=0x7f7d080b89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 -- 172.21.15.16:0/4275517129 shutdown_connections 2024-04-26T22:22:17.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.318+0000 7f7d0da00640 1 -- 172.21.15.16:0/4275517129 wait complete. 2024-04-26T22:22:17.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 Processor -- start 2024-04-26T22:22:17.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- start start 2024-04-26T22:22:17.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b90f0 0x7f7d08144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d08149a30 0x7f7d081e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7d08154dd0 con 0x7f7d080b64e0 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7d08154c50 con 0x7f7d08149a30 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7d08154f50 con 0x7f7d080b90f0 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57188/0 (socket says 172.21.15.16:57188) 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 -- 172.21.15.16:0/1066805245 learned_addr learned my addr 172.21.15.16:0/1066805245 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 -- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b90f0 msgr2=0x7f7d08144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b90f0 0x7f7d08144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 -- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d08149a30 msgr2=0x7f7d081e3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d08149a30 0x7f7d081e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 -- 172.21.15.16:0/1066805245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d081383d0 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d06a00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800c450 tx=0x7f7cf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8017070 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf8005cf0 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d08146940 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8007290 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.322+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d08145120 con 0x7f7d080b64e0 2024-04-26T22:22:17.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d08069450 con 0x7f7d080b64e0 2024-04-26T22:22:17.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7cf801a070 con 0x7f7d080b64e0 2024-04-26T22:22:17.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7cfea00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 0x7f7ce406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7cf8085db0 con 0x7f7d080b64e0 2024-04-26T22:22:17.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7cffe00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 0x7f7ce406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.326+0000 7f7cffe00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 0x7f7ce406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad000 tx=0x7f7cf0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.330+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7cf808a070 con 0x7f7d080b64e0 2024-04-26T22:22:17.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.506+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d08138180 con 0x7f7d080b64e0 2024-04-26T22:22:17.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.506+0000 7f7cfea00640 1 -- 172.21.15.16:0/1066805245 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7f7cf8056360 con 0x7f7d080b64e0 2024-04-26T22:22:17.512 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-26T22:22:17.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 msgr2=0x7f7ce406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 0x7f7ce406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad000 tx=0x7f7cf0004740 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 msgr2=0x7f7d08145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800c450 tx=0x7f7cf800c910 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 shutdown_connections 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7ce4068380 0x7f7ce406a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7d08149a30 0x7f7d081e3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7d080b90f0 0x7f7d08144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 --2- 172.21.15.16:0/1066805245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d080b64e0 0x7f7d08145730 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 >> 172.21.15.16:0/1066805245 conn(0x7f7d080b8600 msgr2=0x7f7d0813d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 shutdown_connections 2024-04-26T22:22:17.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.510+0000 7f7d0da00640 1 -- 172.21.15.16:0/1066805245 wait complete. 2024-04-26T22:22:17.534 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi016.front.sepia.ceph.com... 2024-04-26T22:22:17.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:17.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T22:22:17.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi016.stderr:ceph-fuse[35493]: fuse finished with error 0 and tester_r 0 2024-04-26T22:22:17.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:22:17.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:17.555 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:22:17.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:17.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 Processor -- start 2024-04-26T22:22:17.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 -- start start 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f43cc13ffb0 0x7f43cc140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc073c80 con 0x7f43cc0738a0 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc0706f0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43d1600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc06f930 con 0x7f43cc14a270 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43caa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f43cc0738a0 0x7f43cc149b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47836/0 (socket says 172.21.15.16:47836) 2024-04-26T22:22:17.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43caa00640 1 -- 172.21.15.16:0/1432591160 learned_addr learned my addr 172.21.15.16:0/1432591160 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43cb400640 1 --2- 172.21.15.16:0/1432591160 >> v2:172.21.15.195:3300/0 conn(0x7f43cc13ffb0 0x7f43cc140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43c3e00640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43ca000640 1 -- 172.21.15.16:0/1432591160 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870648706 0 0) 0x7f43cc073c80 con 0x7f43cc0738a0 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.786+0000 7f43ca000640 1 -- 172.21.15.16:0/1432591160 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43b0003530 con 0x7f43cc0738a0 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43cb400640 1 -- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 msgr2=0x7f43cc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43cb400640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43cb400640 1 -- 172.21.15.16:0/1432591160 >> v1:172.21.15.16:6789/0 conn(0x7f43cc0738a0 legacy=0x7f43cc149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43cb400640 1 -- 172.21.15.16:0/1432591160 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0700a0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43cb400640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc13ffb0 0x7f43cc140440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009dc0 tx=0x7f43c401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50f6f3fdc67017a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43ca000640 1 -- 172.21.15.16:0/1432591160 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b2070 con 0x7f43cc13ffb0 2024-04-26T22:22:17.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43ca000640 1 -- 172.21.15.16:0/1432591160 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c40a5800 con 0x7f43cc13ffb0 2024-04-26T22:22:17.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43ca000640 1 -- 172.21.15.16:0/1432591160 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40a5bd0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43d1600640 1 -- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc13ffb0 msgr2=0x7f43cc140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.790+0000 7f43d1600640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc13ffb0 0x7f43cc140440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009dc0 tx=0x7f43c401c8c0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/1432591160 shutdown_connections 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc13ffb0 0x7f43cc140440 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 --2- 172.21.15.16:0/1432591160 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/1432591160 >> 172.21.15.16:0/1432591160 conn(0x7f43cc0b87c0 msgr2=0x7f43cc0b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/1432591160 shutdown_connections 2024-04-26T22:22:17.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/1432591160 wait complete. 2024-04-26T22:22:17.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 Processor -- start 2024-04-26T22:22:17.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- start start 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 0x7f43cc148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc140b00 con 0x7f43cc13ffb0 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc140980 con 0x7f43cc0738a0 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc153430 con 0x7f43cc14a270 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57190/0 (socket says 172.21.15.16:57190) 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 -- 172.21.15.16:0/982884976 learned_addr learned my addr 172.21.15.16:0/982884976 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43cb400640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43caa00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 0x7f43cc148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 -- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 msgr2=0x7f43cc143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 -- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 msgr2=0x7f43cc148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:17.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 0x7f43cc148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:17.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 -- 172.21.15.16:0/982884976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc1e48a0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43cb400640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:17.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43caa00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 0x7f43cc148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c3e00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43b400e8a0 tx=0x7f43b400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4017070 con 0x7f43cc13ffb0 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b400c940 con 0x7f43cc13ffb0 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b400ccf0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc1e4b80 con 0x7f43cc13ffb0 2024-04-26T22:22:17.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.794+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1e43c0 con 0x7f43cc13ffb0 2024-04-26T22:22:17.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.798+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc069530 con 0x7f43cc13ffb0 2024-04-26T22:22:17.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.798+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43b401a070 con 0x7f43cc13ffb0 2024-04-26T22:22:17.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.798+0000 7f43c2a00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:17.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.798+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f43b4086c40 con 0x7f43cc13ffb0 2024-04-26T22:22:17.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.798+0000 7f43caa00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:17.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.802+0000 7f43caa00640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 0x7f43a806a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005890 tx=0x7f43bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:17.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:17.802+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f43b40571f0 con 0x7f43cc13ffb0 2024-04-26T22:22:18.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.002+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43cc1509f0 con 0x7f43cc13ffb0 2024-04-26T22:22:18.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.002+0000 7f43c2a00640 1 -- 172.21.15.16:0/982884976 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7f43b4056af0 con 0x7f43cc13ffb0 2024-04-26T22:22:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:18.008 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:18.009 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 msgr2=0x7f43a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 0x7f43a806a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005890 tx=0x7f43bc009040 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 msgr2=0x7f43cc142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43b400e8a0 tx=0x7f43b400eca0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 shutdown_connections 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f43a8068380 0x7f43a806a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f43cc14a270 0x7f43cc143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43cc13ffb0 0x7f43cc142c00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 --2- 172.21.15.16:0/982884976 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43cc0738a0 0x7f43cc148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 >> 172.21.15.16:0/982884976 conn(0x7f43cc0b87c0 msgr2=0x7f43cc13dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 shutdown_connections 2024-04-26T22:22:18.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.006+0000 7f43d1600640 1 -- 172.21.15.16:0/982884976 wait complete. 2024-04-26T22:22:18.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:18.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 Processor -- start 2024-04-26T22:22:18.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 -- start start 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc5080b7000 0x7fc5080b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc50806d1d0 0x7fc5080b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5080b8e00 con 0x7fc508142490 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc5080b6c00 con 0x7fc5080b7000 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50fc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc5080b7750 con 0x7fc50806d1d0 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc5080b7000 0x7fc5080b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc5080b7000 0x7fc5080b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57206/0 (socket says 172.21.15.16:57206) 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc507e00640 1 --2- 172.21.15.16:0/2005086587 >> v2:172.21.15.195:3300/0 conn(0x7fc50806d1d0 0x7fc5080b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 -- 172.21.15.16:0/2005086587 learned_addr learned my addr 172.21.15.16:0/2005086587 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 -- 172.21.15.16:0/2005086587 >> v2:172.21.15.195:3300/0 conn(0x7fc50806d1d0 msgr2=0x7fc5080b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 --2- 172.21.15.16:0/2005086587 >> v2:172.21.15.195:3300/0 conn(0x7fc50806d1d0 0x7fc5080b88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 -- 172.21.15.16:0/2005086587 >> v1:172.21.15.195:6789/0 conn(0x7fc508142490 legacy=0x7fc508072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.166+0000 7fc50d200640 1 -- 172.21.15.16:0/2005086587 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5080b73e0 con 0x7fc5080b7000 2024-04-26T22:22:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50d200640 1 --2- 172.21.15.16:0/2005086587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5080b7000 0x7fc5080b66c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5081461b0 tx=0x7fc4fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274d4af5e9b438b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc507400640 1 -- 172.21.15.16:0/2005086587 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0b0070 con 0x7fc5080b7000 2024-04-26T22:22:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc507400640 1 -- 172.21.15.16:0/2005086587 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0ab600 con 0x7fc5080b7000 2024-04-26T22:22:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc507400640 1 -- 172.21.15.16:0/2005086587 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ab9d0 con 0x7fc5080b7000 2024-04-26T22:22:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 -- 172.21.15.16:0/2005086587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5080b7000 msgr2=0x7fc5080b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 --2- 172.21.15.16:0/2005086587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5080b7000 0x7fc5080b66c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc5081461b0 tx=0x7fc4fc01c520 comp rx=0 tx=0).stop 2024-04-26T22:22:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 -- 172.21.15.16:0/2005086587 shutdown_connections 2024-04-26T22:22:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 --2- 172.21.15.16:0/2005086587 >> v2:172.21.15.195:3300/0 conn(0x7fc50806d1d0 0x7fc5080b88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 --2- 172.21.15.16:0/2005086587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5080b7000 0x7fc5080b66c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 -- 172.21.15.16:0/2005086587 >> 172.21.15.16:0/2005086587 conn(0x7fc50806f3d0 msgr2=0x7fc50806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 -- 172.21.15.16:0/2005086587 shutdown_connections 2024-04-26T22:22:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.170+0000 7fc50fc00640 1 -- 172.21.15.16:0/2005086587 wait complete. 2024-04-26T22:22:18.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 Processor -- start 2024-04-26T22:22:18.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- start start 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5080b7000 0x7fc5080b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 0x7fc5081e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc5080741d0 con 0x7fc50806d1d0 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc508074050 con 0x7fc508142490 2024-04-26T22:22:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc508155e40 con 0x7fc5080b7000 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57210/0 (socket says 172.21.15.16:57210) 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 -- 172.21.15.16:0/92387540 learned_addr learned my addr 172.21.15.16:0/92387540 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50dc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 0x7fc5081e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc507e00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5080b7000 0x7fc5080b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 -- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5080b7000 msgr2=0x7fc5080b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5080b7000 0x7fc5080b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 -- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 msgr2=0x7fc5081e17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 0x7fc5081e17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 -- 172.21.15.16:0/92387540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50813fee0 con 0x7fc50806d1d0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50dc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 0x7fc5081e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50d200640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc01ca00 tx=0x7fc4fc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0ba020 con 0x7fc50806d1d0 2024-04-26T22:22:18.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0b6420 con 0x7fc50806d1d0 2024-04-26T22:22:18.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc508148610 con 0x7fc50806d1d0 2024-04-26T22:22:18.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0b0040 con 0x7fc50806d1d0 2024-04-26T22:22:18.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.174+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc508144700 con 0x7fc50806d1d0 2024-04-26T22:22:18.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc508069530 con 0x7fc50806d1d0 2024-04-26T22:22:18.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4fc0bd020 con 0x7fc50806d1d0 2024-04-26T22:22:18.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc504c00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 0x7fc4e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc120a10 con 0x7fc50806d1d0 2024-04-26T22:22:18.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc507e00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 0x7fc4e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.178+0000 7fc507e00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 0x7fc4e806a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5081481a0 tx=0x7fc4f4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.182+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc4fc0c4030 con 0x7fc50806d1d0 2024-04-26T22:22:18.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.346+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc50813fb50 con 0x7fc50806d1d0 2024-04-26T22:22:18.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc504c00640 1 -- 172.21.15.16:0/92387540 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16657 (secure 0 0 0) 0x7fc4fc016110 con 0x7fc50806d1d0 2024-04-26T22:22:18.353 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:18.353 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:08.552305+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 msgr2=0x7fc4e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 0x7fc4e806a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5081481a0 tx=0x7fc4f4009190 comp rx=0 tx=0).stop 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 msgr2=0x7fc508143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc01ca00 tx=0x7fc4fc01ad60 comp rx=0 tx=0).stop 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 shutdown_connections 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc4e80683b0 0x7fc4e806a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc508142490 0x7fc5081e17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5080b7000 0x7fc5080b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 --2- 172.21.15.16:0/92387540 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc50806d1d0 0x7fc508143ef0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 >> 172.21.15.16:0/92387540 conn(0x7fc50806f3d0 msgr2=0x7fc50813dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 shutdown_connections 2024-04-26T22:22:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.350+0000 7fc50fc00640 1 -- 172.21.15.16:0/92387540 wait complete. 2024-04-26T22:22:18.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T22:21:10.129112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:22:04.803346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:22:05.921975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:22:18.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:22:18.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 Processor -- start 2024-04-26T22:22:18.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 -- start start 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 0x7fcb54149910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb540b8250 0x7fcb54140070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb54149e50 con 0x7fcb541405b0 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcb54073d00 con 0x7fcb540b8250 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb5a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcb540b7dc0 con 0x7fcb54070280 2024-04-26T22:22:18.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb540b8250 0x7fcb54140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb540b8250 0x7fcb54140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57212/0 (socket says 172.21.15.16:57212) 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 -- 172.21.15.16:0/3793211729 learned_addr learned my addr 172.21.15.16:0/3793211729 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb53400640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 0x7fcb54149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 -- 172.21.15.16:0/3793211729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 msgr2=0x7fcb54149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 0x7fcb54149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 -- 172.21.15.16:0/3793211729 >> v1:172.21.15.195:6789/0 conn(0x7fcb541405b0 legacy=0x7fcb540b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb4aa00640 1 -- 172.21.15.16:0/3793211729 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb54070660 con 0x7fcb540b8250 2024-04-26T22:22:18.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.514+0000 7fcb53400640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 0x7fcb54149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:18.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb540b8250 0x7fcb54140070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4a63dbea9e4477 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb52a00640 1 -- 172.21.15.16:0/3793211729 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b0070 con 0x7fcb540b8250 2024-04-26T22:22:18.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb52a00640 1 -- 172.21.15.16:0/3793211729 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0ab600 con 0x7fcb540b8250 2024-04-26T22:22:18.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb52a00640 1 -- 172.21.15.16:0/3793211729 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0ab9d0 con 0x7fcb540b8250 2024-04-26T22:22:18.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 -- 172.21.15.16:0/3793211729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb540b8250 msgr2=0x7fcb54140070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb540b8250 0x7fcb54140070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c01c440 comp rx=0 tx=0).stop 2024-04-26T22:22:18.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 -- 172.21.15.16:0/3793211729 shutdown_connections 2024-04-26T22:22:18.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb540b8250 0x7fcb54140070 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 --2- 172.21.15.16:0/3793211729 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb54070280 0x7fcb54149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 -- 172.21.15.16:0/3793211729 >> 172.21.15.16:0/3793211729 conn(0x7fcb540b8850 msgr2=0x7fcb540b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 -- 172.21.15.16:0/3793211729 shutdown_connections 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 -- 172.21.15.16:0/3793211729 wait complete. 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.518+0000 7fcb5a200640 1 Processor -- start 2024-04-26T22:22:18.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- start start 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 0x7fcb5413b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb541405b0 0x7fcb5413ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb54140b40 con 0x7fcb54070280 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fcb541409c0 con 0x7fcb540b8250 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fcb54071140 con 0x7fcb541405b0 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57226/0 (socket says 172.21.15.16:57226) 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 -- 172.21.15.16:0/2815231303 learned_addr learned my addr 172.21.15.16:0/2815231303 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 0x7fcb5413b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53e00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb541405b0 0x7fcb5413ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 -- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb541405b0 msgr2=0x7fcb5413ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb541405b0 0x7fcb5413ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 -- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 msgr2=0x7fcb5413b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 0x7fcb5413b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 -- 172.21.15.16:0/2815231303 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb54142520 con 0x7fcb54070280 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 0x7fcb5413b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb53400640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400e840 tx=0x7fcb4400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44017070 con 0x7fcb54070280 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400c8d0 con 0x7fcb54070280 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400f040 con 0x7fcb54070280 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb54148c00 con 0x7fcb54070280 2024-04-26T22:22:18.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb54142240 con 0x7fcb54070280 2024-04-26T22:22:18.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.522+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb541489f0 con 0x7fcb54070280 2024-04-26T22:22:18.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.526+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb4401a070 con 0x7fcb54070280 2024-04-26T22:22:18.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.526+0000 7fcb4be00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 0x7fcb3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.526+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fcb44086570 con 0x7fcb54070280 2024-04-26T22:22:18.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.526+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 0x7fcb3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.526+0000 7fcb4aa00640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 0x7fcb3006a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ad000 tx=0x7fcb3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.530+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb44056bc0 con 0x7fcb54070280 2024-04-26T22:22:18.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.694+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb54069530 con 0x7fcb54070280 2024-04-26T22:22:18.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.694+0000 7fcb4be00640 1 -- 172.21.15.16:0/2815231303 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7fcb440564c0 con 0x7fcb54070280 2024-04-26T22:22:18.699 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-26T22:22:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 msgr2=0x7fcb3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 0x7fcb3006a870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ad000 tx=0x7fcb3c008040 comp rx=0 tx=0).stop 2024-04-26T22:22:18.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 msgr2=0x7fcb54140f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400e840 tx=0x7fcb4400ed00 comp rx=0 tx=0).stop 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 shutdown_connections 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fcb300683b0 0x7fcb3006a870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcb541405b0 0x7fcb5413ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcb540b8250 0x7fcb5413b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 --2- 172.21.15.16:0/2815231303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb54070280 0x7fcb54140f70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 >> 172.21.15.16:0/2815231303 conn(0x7fcb540b8850 msgr2=0x7fcb540a0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 shutdown_connections 2024-04-26T22:22:18.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.698+0000 7fcb5a200640 1 -- 172.21.15.16:0/2815231303 wait complete. 2024-04-26T22:22:18.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:22:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.858+0000 7f325d200640 1 Processor -- start 2024-04-26T22:22:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.858+0000 7f325d200640 1 -- start start 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f325d200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325806e410 0x7f325813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f325d200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32580b0a30 0x7f3258140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f325d200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3258070480 con 0x7f32581464e0 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f325d200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3258070a60 con 0x7f325806e410 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f325d200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f32580718a0 con 0x7f32580b0a30 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325806e410 0x7f325813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f325806e410 0x7f325813ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57238/0 (socket says 172.21.15.16:57238) 2024-04-26T22:22:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 -- 172.21.15.16:0/683933034 learned_addr learned my addr 172.21.15.16:0/683933034 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f324d400640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32580b0a30 0x7f3258140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 -- 172.21.15.16:0/683933034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32580b0a30 msgr2=0x7f3258140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32580b0a30 0x7f3258140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 -- 172.21.15.16:0/683933034 >> v1:172.21.15.195:6789/0 conn(0x7f32581464e0 legacy=0x7f3258146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.862+0000 7f3255e00640 1 -- 172.21.15.16:0/683933034 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325806e7f0 con 0x7f325806e410 2024-04-26T22:22:18.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255e00640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f325813ffd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3248009e50 tx=0x7f324801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6ec444a475e66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255400640 1 -- 172.21.15.16:0/683933034 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32480a5850 con 0x7f325806e410 2024-04-26T22:22:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255400640 1 -- 172.21.15.16:0/683933034 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32480a59f0 con 0x7f325806e410 2024-04-26T22:22:18.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255400640 1 -- 172.21.15.16:0/683933034 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32480a5dc0 con 0x7f325806e410 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- 172.21.15.16:0/683933034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 msgr2=0x7f325813ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f325813ffd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3248009e50 tx=0x7f324801c970 comp rx=0 tx=0).stop 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- 172.21.15.16:0/683933034 shutdown_connections 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32580b0a30 0x7f3258140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- 172.21.15.16:0/683933034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f325813ffd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- 172.21.15.16:0/683933034 >> 172.21.15.16:0/683933034 conn(0x7f32580b6590 msgr2=0x7f32580b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- 172.21.15.16:0/683933034 shutdown_connections 2024-04-26T22:22:18.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- 172.21.15.16:0/683933034 wait complete. 2024-04-26T22:22:18.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 Processor -- start 2024-04-26T22:22:18.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- start start 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32580b0a30 0x7f32581e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 0x7f3258073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3258153520 con 0x7f325806e410 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f32581533a0 con 0x7f32580b0a30 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f325d200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f32581536a0 con 0x7f32581464e0 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57240/0 (socket says 172.21.15.16:57240) 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.866+0000 7f3255e00640 1 -- 172.21.15.16:0/8989312 learned_addr learned my addr 172.21.15.16:0/8989312 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324d400640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32580b0a30 0x7f32581e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3256800640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 0x7f3258073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 -- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 msgr2=0x7f3258073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 0x7f3258073850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 -- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32580b0a30 msgr2=0x7f32581e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32580b0a30 0x7f32581e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 -- 172.21.15.16:0/8989312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3258141330 con 0x7f325806e410 2024-04-26T22:22:18.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3256800640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 0x7f3258073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f3255e00640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f324801a5a0 tx=0x7f3248019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32480bc020 con 0x7f325806e410 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32480b8670 con 0x7f325806e410 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580b1f60 con 0x7f325806e410 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32480b8a60 con 0x7f325806e410 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325814fe30 con 0x7f325806e410 2024-04-26T22:22:18.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32580b1a20 con 0x7f325806e410 2024-04-26T22:22:18.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32480bf020 con 0x7f325806e410 2024-04-26T22:22:18.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 0x7f323406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:18.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.870+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f32481216e0 con 0x7f325806e410 2024-04-26T22:22:18.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.874+0000 7f324d400640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 0x7f323406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:18.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.874+0000 7f324d400640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 0x7f323406a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32581472d0 tx=0x7f3240009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:18.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:18.874+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f32480c6070 con 0x7f325806e410 2024-04-26T22:22:19.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3258069530 con 0x7f325806e410 2024-04-26T22:22:19.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f324ea00640 1 -- 172.21.15.16:0/8989312 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f3248016620 con 0x7f325806e410 2024-04-26T22:22:19.046 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-26T22:22:19.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 msgr2=0x7f323406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 0x7f323406a870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f32581472d0 tx=0x7f3240009190 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 msgr2=0x7f32580b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f324801a5a0 tx=0x7f3248019710 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 shutdown_connections 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f32340683b0 0x7f323406a870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f32581464e0 0x7f3258073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f32580b0a30 0x7f32581e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 --2- 172.21.15.16:0/8989312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f325806e410 0x7f32580b1450 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 >> 172.21.15.16:0/8989312 conn(0x7f32580b6590 msgr2=0x7f325813e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 shutdown_connections 2024-04-26T22:22:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.042+0000 7f325d200640 1 -- 172.21.15.16:0/8989312 wait complete. 2024-04-26T22:22:19.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:22:19.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 Processor -- start 2024-04-26T22:22:19.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 -- start start 2024-04-26T22:22:19.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9840b0a30 0x7ff9841464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff9841406e0 0x7ff984146a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff984070480 con 0x7ff98406e410 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7ff984070a60 con 0x7ff9841406e0 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff98a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9840718a0 con 0x7ff9840b0a30 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff983400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff98406e410 0x7ff98413ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47852/0 (socket says 172.21.15.16:47852) 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff983400640 1 -- 172.21.15.16:0/1027586417 learned_addr learned my addr 172.21.15.16:0/1027586417 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff983e00640 1 --2- 172.21.15.16:0/1027586417 >> v2:172.21.15.195:3300/0 conn(0x7ff9841406e0 0x7ff984146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.206+0000 7ff97aa00640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9840b0a30 0x7ff9841464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff982a00640 1 -- 172.21.15.16:0/1027586417 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958884625 0 0) 0x7ff984070480 con 0x7ff98406e410 2024-04-26T22:22:19.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff982a00640 1 -- 172.21.15.16:0/1027586417 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff968003530 con 0x7ff98406e410 2024-04-26T22:22:19.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff983e00640 1 -- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9840b0a30 msgr2=0x7ff9841464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:19.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff983e00640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9840b0a30 0x7ff9841464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff983e00640 1 -- 172.21.15.16:0/1027586417 >> v1:172.21.15.16:6789/0 conn(0x7ff98406e410 legacy=0x7ff98413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff983e00640 1 -- 172.21.15.16:0/1027586417 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98406e7f0 con 0x7ff9841406e0 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff983e00640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9841406e0 0x7ff984146a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009d90 tx=0x7ff97c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6460f06c9f0eb412 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff982a00640 1 -- 172.21.15.16:0/1027586417 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0b2070 con 0x7ff9841406e0 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff982a00640 1 -- 172.21.15.16:0/1027586417 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c0a59c0 con 0x7ff9841406e0 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.210+0000 7ff982a00640 1 -- 172.21.15.16:0/1027586417 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0a5d70 con 0x7ff9841406e0 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9841406e0 msgr2=0x7ff984146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9841406e0 0x7ff984146a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009d90 tx=0x7ff97c01c8e0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/1027586417 shutdown_connections 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9841406e0 0x7ff984146a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- 172.21.15.16:0/1027586417 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9840b0a30 0x7ff9841464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/1027586417 >> 172.21.15.16:0/1027586417 conn(0x7ff9840b6590 msgr2=0x7ff9840b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/1027586417 shutdown_connections 2024-04-26T22:22:19.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/1027586417 wait complete. 2024-04-26T22:22:19.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 Processor -- start 2024-04-26T22:22:19.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- start start 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff98406e410 0x7ff9840b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9841406e0 0x7ff9840720a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff984153520 con 0x7ff9840b0a30 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841533a0 con 0x7ff98406e410 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7ff9841536a0 con 0x7ff9841406e0 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57254/0 (socket says 172.21.15.16:57254) 2024-04-26T22:22:19.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 -- 172.21.15.16:0/4176682714 learned_addr learned my addr 172.21.15.16:0/4176682714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff983400640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff98406e410 0x7ff9840b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff983e00640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9841406e0 0x7ff9840720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 -- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9841406e0 msgr2=0x7ff9840720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9841406e0 0x7ff9840720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 -- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff98406e410 msgr2=0x7ff9840b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff98406e410 0x7ff9840b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 -- 172.21.15.16:0/4176682714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9841e4260 con 0x7ff9840b0a30 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97aa00640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00e960 tx=0x7ff96c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c017070 con 0x7ff9840b0a30 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff96c00ca00 con 0x7ff9840b0a30 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9841e44d0 con 0x7ff9840b0a30 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.214+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00cdb0 con 0x7ff9840b0a30 2024-04-26T22:22:19.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff984074100 con 0x7ff9840b0a30 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff984069530 con 0x7ff9840b0a30 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff96c01a070 con 0x7ff9840b0a30 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff97be00640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 0x7ff96006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff96c086930 con 0x7ff9840b0a30 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff983400640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 0x7ff96006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.218+0000 7ff983400640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 0x7ff96006a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff974005890 tx=0x7ff974009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.222+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff96c056f80 con 0x7ff9840b0a30 2024-04-26T22:22:19.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.386+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff98406cad0 con 0x7ff9840b0a30 2024-04-26T22:22:19.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.386+0000 7ff97be00640 1 -- 172.21.15.16:0/4176682714 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7ff96c056880 con 0x7ff9840b0a30 2024-04-26T22:22:19.393 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 msgr2=0x7ff96006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 0x7ff96006a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff974005890 tx=0x7ff974009040 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 msgr2=0x7ff9841e0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00e960 tx=0x7ff96c00ee20 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 shutdown_connections 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7ff960068380 0x7ff96006a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff9841406e0 0x7ff9840720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9840b0a30 0x7ff9841e0740 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 --2- 172.21.15.16:0/4176682714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff98406e410 0x7ff9840b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 >> 172.21.15.16:0/4176682714 conn(0x7ff9840b6590 msgr2=0x7ff9841457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 shutdown_connections 2024-04-26T22:22:19.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.390+0000 7ff98a000640 1 -- 172.21.15.16:0/4176682714 wait complete. 2024-04-26T22:22:19.414 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 Processor -- start 2024-04-26T22:22:19.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 -- start start 2024-04-26T22:22:19.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb324140880 0x7fb324151c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb324146a90 con 0x7fb324073d90 2024-04-26T22:22:19.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3240b8dd0 con 0x7fb3240b8680 2024-04-26T22:22:19.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb329c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240b6b80 con 0x7fb324140880 2024-04-26T22:22:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb31a000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb324073d90 0x7fb324140170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47868/0 (socket says 172.21.15.16:47868) 2024-04-26T22:22:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb31a000640 1 -- 172.21.15.16:0/2159403974 learned_addr learned my addr 172.21.15.16:0/2159403974 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb323400640 1 --2- 172.21.15.16:0/2159403974 >> v2:172.21.15.16:3300/0 conn(0x7fb324140880 0x7fb324151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb322000640 1 -- 172.21.15.16:0/2159403974 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240829057 0 0) 0x7fb324146a90 con 0x7fb324073d90 2024-04-26T22:22:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb322000640 1 -- 172.21.15.16:0/2159403974 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb308003530 con 0x7fb324073d90 2024-04-26T22:22:19.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb323400640 1 -- 172.21.15.16:0/2159403974 >> v1:172.21.15.195:6789/0 conn(0x7fb3240b8680 legacy=0x7fb324146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb323400640 1 -- 172.21.15.16:0/2159403974 >> v1:172.21.15.16:6789/0 conn(0x7fb324073d90 legacy=0x7fb324140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.550+0000 7fb323400640 1 -- 172.21.15.16:0/2159403974 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb324149ea0 con 0x7fb324140880 2024-04-26T22:22:19.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb323400640 1 --2- 172.21.15.16:0/2159403974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb324151c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0097c0 tx=0x7fb31c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b0fdcb950bddac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb322000640 1 -- 172.21.15.16:0/2159403974 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b0070 con 0x7fb324140880 2024-04-26T22:22:19.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb322000640 1 -- 172.21.15.16:0/2159403974 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c0ab600 con 0x7fb324140880 2024-04-26T22:22:19.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb322000640 1 -- 172.21.15.16:0/2159403974 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ab9d0 con 0x7fb324140880 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 -- 172.21.15.16:0/2159403974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 msgr2=0x7fb324151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 --2- 172.21.15.16:0/2159403974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb324151c30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0097c0 tx=0x7fb31c01c410 comp rx=0 tx=0).stop 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 -- 172.21.15.16:0/2159403974 shutdown_connections 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 --2- 172.21.15.16:0/2159403974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb324151c30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 -- 172.21.15.16:0/2159403974 >> 172.21.15.16:0/2159403974 conn(0x7fb32406f3d0 msgr2=0x7fb32406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 -- 172.21.15.16:0/2159403974 shutdown_connections 2024-04-26T22:22:19.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.554+0000 7fb329c00640 1 -- 172.21.15.16:0/2159403974 wait complete. 2024-04-26T22:22:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 Processor -- start 2024-04-26T22:22:19.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- start start 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb324073d90 0x7fb3241e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 0x7fb3241e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb324154b10 con 0x7fb324140880 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb324154990 con 0x7fb324073d90 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb324154c90 con 0x7fb3240b8680 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb31a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 0x7fb3241e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb322a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb324073d90 0x7fb3241e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57268/0 (socket says 172.21.15.16:57268) 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 -- 172.21.15.16:0/1488917274 learned_addr learned my addr 172.21.15.16:0/1488917274 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb31a000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 0x7fb3241e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:39072/0 (socket says 172.21.15.16:39072) 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 -- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 msgr2=0x7fb3241e2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 0x7fb3241e2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 -- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb324073d90 msgr2=0x7fb3241e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb324073d90 0x7fb3241e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 -- 172.21.15.16:0/1488917274 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32413b7a0 con 0x7fb324140880 2024-04-26T22:22:19.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb323400640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb31c019020 tx=0x7fb31c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0abe60 con 0x7fb324140880 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb31c0b9070 con 0x7fb324140880 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b0040 con 0x7fb324140880 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32413aed0 con 0x7fb324140880 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32413ca30 con 0x7fb324140880 2024-04-26T22:22:19.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.558+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb324069530 con 0x7fb324140880 2024-04-26T22:22:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.562+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb31c0b4650 con 0x7fb324140880 2024-04-26T22:22:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.562+0000 7fb31b400640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 0x7fb30006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.562+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb31c120460 con 0x7fb324140880 2024-04-26T22:22:19.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.562+0000 7fb322a00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 0x7fb30006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.562+0000 7fb322a00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 0x7fb30006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb314001e80 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.566+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb31c016090 con 0x7fb324140880 2024-04-26T22:22:19.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3240b16b0 con 0x7fb324140880 2024-04-26T22:22:19.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb31b400640 1 -- 172.21.15.16:0/1488917274 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7fb31c0f03c0 con 0x7fb324140880 2024-04-26T22:22:19.770 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:19.770 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:19.771 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:19.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 msgr2=0x7fb30006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 0x7fb30006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb314001e80 tx=0x7fb314009040 comp rx=0 tx=0).stop 2024-04-26T22:22:19.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 msgr2=0x7fb3241df080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb31c019020 tx=0x7fb31c0191b0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 shutdown_connections 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb300068380 0x7fb30006a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb324140880 0x7fb3241df080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb3240b8680 0x7fb3241e2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 --2- 172.21.15.16:0/1488917274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb324073d90 0x7fb3241e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 >> 172.21.15.16:0/1488917274 conn(0x7fb32406f3d0 msgr2=0x7fb324072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 shutdown_connections 2024-04-26T22:22:19.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.766+0000 7fb329c00640 1 -- 172.21.15.16:0/1488917274 wait complete. 2024-04-26T22:22:19.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 Processor -- start 2024-04-26T22:22:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 -- start start 2024-04-26T22:22:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63780b6710 0x7f637806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637814ad50 0x7f637814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637814b720 con 0x7f637806e790 2024-04-26T22:22:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f63780b0e70 con 0x7f63780b6710 2024-04-26T22:22:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.926+0000 7f6377e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f63780b0860 con 0x7f637814ad50 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63780b6710 0x7f637806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63780b6710 0x7f637806fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57276/0 (socket says 172.21.15.16:57276) 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 -- 172.21.15.16:0/3925503762 learned_addr learned my addr 172.21.15.16:0/3925503762 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6377400640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637814ad50 0x7f637814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 -- 172.21.15.16:0/3925503762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637814ad50 msgr2=0x7f637814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637814ad50 0x7f637814b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 -- 172.21.15.16:0/3925503762 >> v1:172.21.15.195:6789/0 conn(0x7f637806e790 legacy=0x7f637806ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 -- 172.21.15.16:0/3925503762 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63780b6af0 con 0x7f63780b6710 2024-04-26T22:22:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376a00640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63780b6710 0x7f637806fa50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6368009870 tx=0x7f636801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6bc1924f3542e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376000640 1 -- 172.21.15.16:0/3925503762 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63680ab610 con 0x7f63780b6710 2024-04-26T22:22:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376000640 1 -- 172.21.15.16:0/3925503762 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63680b0070 con 0x7f63780b6710 2024-04-26T22:22:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.930+0000 7f6376000640 1 -- 172.21.15.16:0/3925503762 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63680ab9d0 con 0x7f63780b6710 2024-04-26T22:22:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- 172.21.15.16:0/3925503762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63780b6710 msgr2=0x7f637806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63780b6710 0x7f637806fa50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6368009870 tx=0x7f636801c410 comp rx=0 tx=0).stop 2024-04-26T22:22:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- 172.21.15.16:0/3925503762 shutdown_connections 2024-04-26T22:22:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637814ad50 0x7f637814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- 172.21.15.16:0/3925503762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63780b6710 0x7f637806fa50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- 172.21.15.16:0/3925503762 >> 172.21.15.16:0/3925503762 conn(0x7f63780b75a0 msgr2=0x7f63780b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- 172.21.15.16:0/3925503762 shutdown_connections 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- 172.21.15.16:0/3925503762 wait complete. 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 Processor -- start 2024-04-26T22:22:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- start start 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637806e790 0x7f63781dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63780b6710 0x7f63781e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63781554d0 con 0x7f637814ad50 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f63780b7140 con 0x7f63780b6710 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6378155650 con 0x7f637806e790 2024-04-26T22:22:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57278/0 (socket says 172.21.15.16:57278) 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 -- 172.21.15.16:0/2593175895 learned_addr learned my addr 172.21.15.16:0/2593175895 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6376a00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637806e790 0x7f63781dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f636fe00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63780b6710 0x7f63781e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 -- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637806e790 msgr2=0x7f63781dafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637806e790 0x7f63781dafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 -- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63780b6710 msgr2=0x7f63781e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63780b6710 0x7f63781e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 -- 172.21.15.16:0/2593175895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63781db500 con 0x7f637814ad50 2024-04-26T22:22:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f6377400640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6370007e40 tx=0x7f637000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.934+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370014620 con 0x7f637814ad50 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6370019070 con 0x7f637814ad50 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370014a20 con 0x7f637814ad50 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637813db50 con 0x7f637814ad50 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781daaa0 con 0x7f637814ad50 2024-04-26T22:22:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637806d390 con 0x7f637814ad50 2024-04-26T22:22:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6370014bc0 con 0x7f637814ad50 2024-04-26T22:22:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f636ea00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 0x7f635406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6370087130 con 0x7f637814ad50 2024-04-26T22:22:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.938+0000 7f6376a00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 0x7f635406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.942+0000 7f6376a00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 0x7f635406a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63680af000 tx=0x7f63680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:19.942+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6370057090 con 0x7f637814ad50 2024-04-26T22:22:20.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.110+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6378144ec0 con 0x7f637814ad50 2024-04-26T22:22:20.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.110+0000 7f636ea00640 1 -- 172.21.15.16:0/2593175895 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16657 (secure 0 0 0) 0x7f637005b390 con 0x7f637814ad50 2024-04-26T22:22:20.116 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:20.116 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:08.552305+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 msgr2=0x7f635406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 0x7f635406a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f63680af000 tx=0x7f63680a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 msgr2=0x7f63781377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6370007e40 tx=0x7f637000e4b0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 shutdown_connections 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f63540683b0 0x7f635406a870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f637814ad50 0x7f63781377d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63780b6710 0x7f63781e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 --2- 172.21.15.16:0/2593175895 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f637806e790 0x7f63781dafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 >> 172.21.15.16:0/2593175895 conn(0x7f63780b75a0 msgr2=0x7f63780b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 shutdown_connections 2024-04-26T22:22:20.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.114+0000 7f6377e00640 1 -- 172.21.15.16:0/2593175895 wait complete. 2024-04-26T22:22:20.138 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:22:20.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 Processor -- start 2024-04-26T22:22:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 -- start start 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11c4148fd0 0x7f11c4153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c4075e50 con 0x7f11c41424b0 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c40b4f30 con 0x7f11c4075a70 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c9e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f11c40b4ce0 con 0x7f11c4148fd0 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11ba000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f11c41424b0 0x7f11c41488c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47880/0 (socket says 172.21.15.16:47880) 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11ba000640 1 -- 172.21.15.16:0/3946022440 learned_addr learned my addr 172.21.15.16:0/3946022440 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c3400640 1 --2- 172.21.15.16:0/3946022440 >> v2:172.21.15.16:3300/0 conn(0x7f11c4148fd0 0x7f11c4153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c3400640 1 -- 172.21.15.16:0/3946022440 >> v1:172.21.15.195:6789/0 conn(0x7f11c4075a70 legacy=0x7f11c40b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c3400640 1 -- 172.21.15.16:0/3946022440 >> v1:172.21.15.16:6789/0 conn(0x7f11c41424b0 legacy=0x7f11c41488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c3400640 1 -- 172.21.15.16:0/3946022440 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c40b5210 con 0x7f11c4148fd0 2024-04-26T22:22:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.274+0000 7f11c2000640 1 -- 172.21.15.16:0/3946022440 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870233326 0 0) 0x7f11c4075e50 con 0x7f11c41424b0 2024-04-26T22:22:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c3400640 1 --2- 172.21.15.16:0/3946022440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4153d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f11c40b4e60 tx=0x7f11bc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c8bdd9bb30d9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c2000640 1 -- 172.21.15.16:0/3946022440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0b2070 con 0x7f11c4148fd0 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c2000640 1 -- 172.21.15.16:0/3946022440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11bc0a5780 con 0x7f11c4148fd0 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c2000640 1 -- 172.21.15.16:0/3946022440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0a5b50 con 0x7f11c4148fd0 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 -- 172.21.15.16:0/3946022440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 msgr2=0x7f11c4153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3946022440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4153d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f11c40b4e60 tx=0x7f11bc01c8c0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 -- 172.21.15.16:0/3946022440 shutdown_connections 2024-04-26T22:22:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3946022440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4153d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 -- 172.21.15.16:0/3946022440 >> 172.21.15.16:0/3946022440 conn(0x7f11c40b6de0 msgr2=0x7f11c40b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 -- 172.21.15.16:0/3946022440 shutdown_connections 2024-04-26T22:22:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.278+0000 7f11c9e00640 1 -- 172.21.15.16:0/3946022440 wait complete. 2024-04-26T22:22:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 Processor -- start 2024-04-26T22:22:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- start start 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 0x7f11c41457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c41424b0 0x7f11c409f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f11c4156d00 con 0x7f11c4148fd0 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f11c40b5e20 con 0x7f11c41424b0 2024-04-26T22:22:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f11c4156e80 con 0x7f11c4075a70 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57288/0 (socket says 172.21.15.16:57288) 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 -- 172.21.15.16:0/3980087414 learned_addr learned my addr 172.21.15.16:0/3980087414 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11ba000640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c41424b0 0x7f11c409f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c2a00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 0x7f11c41457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 -- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 msgr2=0x7f11c41457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 0x7f11c41457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 -- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c41424b0 msgr2=0x7f11c409f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c41424b0 0x7f11c409f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 -- 172.21.15.16:0/3980087414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c409f9f0 con 0x7f11c4148fd0 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c2a00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 0x7f11c41457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c3400640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f11bc01a4f0 tx=0x7f11bc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0b2050 con 0x7f11c4148fd0 2024-04-26T22:22:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11bc0be070 con 0x7f11c4148fd0 2024-04-26T22:22:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c409f710 con 0x7f11c4148fd0 2024-04-26T22:22:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0adc40 con 0x7f11c4148fd0 2024-04-26T22:22:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.282+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c41448d0 con 0x7f11c4148fd0 2024-04-26T22:22:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c4145d50 con 0x7f11c4148fd0 2024-04-26T22:22:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11bc0c3460 con 0x7f11c4148fd0 2024-04-26T22:22:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11bbe00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 0x7f11a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f11bc121d00 con 0x7f11c4148fd0 2024-04-26T22:22:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11c2a00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 0x7f11a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.286+0000 7f11c2a00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 0x7f11a006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000f70 tx=0x7f11b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.290+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11c4145d50 con 0x7f11c4148fd0 2024-04-26T22:22:20.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.489+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c4069530 con 0x7f11c4148fd0 2024-04-26T22:22:20.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.489+0000 7f11bbe00640 1 -- 172.21.15.16:0/3980087414 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7f11bc016540 con 0x7f11c4148fd0 2024-04-26T22:22:20.495 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:20.495 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:20.496 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:20.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 msgr2=0x7f11a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 0x7f11a006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000f70 tx=0x7f11b4009040 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 msgr2=0x7f11c4142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f11bc01a4f0 tx=0x7f11bc019660 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 shutdown_connections 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f11a0068380 0x7f11a006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11c4148fd0 0x7f11c4142e50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11c41424b0 0x7f11c409f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 --2- 172.21.15.16:0/3980087414 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f11c4075a70 0x7f11c41457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 >> 172.21.15.16:0/3980087414 conn(0x7f11c40b6de0 msgr2=0x7f11c406dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 shutdown_connections 2024-04-26T22:22:20.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.493+0000 7f11c9e00640 1 -- 172.21.15.16:0/3980087414 wait complete. 2024-04-26T22:22:20.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:20.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 Processor -- start 2024-04-26T22:22:20.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 -- start start 2024-04-26T22:22:20.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f24d80b7000 0x7f24d80b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d80b8e00 con 0x7f24d8142490 2024-04-26T22:22:20.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f24d80b6c00 con 0x7f24d80b7000 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ddc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80b7750 con 0x7f24d806d1d0 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d7400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f24d8142490 0x7f24d8072610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47892/0 (socket says 172.21.15.16:47892) 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d7400640 1 -- 172.21.15.16:0/2653645398 learned_addr learned my addr 172.21.15.16:0/2653645398 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6a00640 1 --2- 172.21.15.16:0/2653645398 >> v2:172.21.15.195:3300/0 conn(0x7f24d80b7000 0x7f24d80b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24ce000640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6000640 1 -- 172.21.15.16:0/2653645398 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597266303 0 0) 0x7f24d80b8e00 con 0x7f24d8142490 2024-04-26T22:22:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6000640 1 -- 172.21.15.16:0/2653645398 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24bc003530 con 0x7f24d8142490 2024-04-26T22:22:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6a00640 1 -- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 msgr2=0x7f24d80b88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6a00640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80b88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6a00640 1 -- 172.21.15.16:0/2653645398 >> v1:172.21.15.16:6789/0 conn(0x7f24d8142490 legacy=0x7f24d8072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.653+0000 7f24d6a00640 1 -- 172.21.15.16:0/2653645398 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d80b73e0 con 0x7f24d80b7000 2024-04-26T22:22:20.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24d6a00640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80b7000 0x7f24d80b66c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009dc0 tx=0x7f24c801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd547c90f63ef7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24d6000640 1 -- 172.21.15.16:0/2653645398 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80b2070 con 0x7f24d80b7000 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24d6000640 1 -- 172.21.15.16:0/2653645398 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c80a5810 con 0x7f24d80b7000 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24d6000640 1 -- 172.21.15.16:0/2653645398 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5be0 con 0x7f24d80b7000 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 -- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80b7000 msgr2=0x7f24d80b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80b7000 0x7f24d80b66c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009dc0 tx=0x7f24c801c950 comp rx=0 tx=0).stop 2024-04-26T22:22:20.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 -- 172.21.15.16:0/2653645398 shutdown_connections 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80b88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 --2- 172.21.15.16:0/2653645398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80b7000 0x7f24d80b66c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 -- 172.21.15.16:0/2653645398 >> 172.21.15.16:0/2653645398 conn(0x7f24d806f3d0 msgr2=0x7f24d806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 -- 172.21.15.16:0/2653645398 shutdown_connections 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.657+0000 7f24ddc00640 1 -- 172.21.15.16:0/2653645398 wait complete. 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 Processor -- start 2024-04-26T22:22:20.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- start start 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80bb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 0x7f24d81e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24d80741d0 con 0x7f24d80b7000 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8074050 con 0x7f24d8142490 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f24d8155e40 con 0x7f24d806d1d0 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57300/0 (socket says 172.21.15.16:57300) 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 -- 172.21.15.16:0/3988890813 learned_addr learned my addr 172.21.15.16:0/3988890813 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24d6a00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24d7400640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 0x7f24d81e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 -- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 msgr2=0x7f24d80bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80bb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 -- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 msgr2=0x7f24d81e4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 0x7f24d81e4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 -- 172.21.15.16:0/3988890813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8153ba0 con 0x7f24d80b7000 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24d7400640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 0x7f24d81e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ce000640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24c000e960 tx=0x7f24c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c0017070 con 0x7f24d80b7000 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c000ca00 con 0x7f24d80b7000 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c000cdb0 con 0x7f24d80b7000 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d81e14c0 con 0x7f24d80b7000 2024-04-26T22:22:20.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.661+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d81443c0 con 0x7f24d80b7000 2024-04-26T22:22:20.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d8069530 con 0x7f24d80b7000 2024-04-26T22:22:20.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24c001a070 con 0x7f24d80b7000 2024-04-26T22:22:20.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24cf400640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 0x7f24b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:20.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f24c0086d10 con 0x7f24d80b7000 2024-04-26T22:22:20.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24d6a00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 0x7f24b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:20.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.665+0000 7f24d6a00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 0x7f24b406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24c80af000 tx=0x7f24c80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:20.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.669+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f24c008c020 con 0x7f24d80b7000 2024-04-26T22:22:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24d81338f0 con 0x7f24d80b7000 2024-04-26T22:22:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24cf400640 1 -- 172.21.15.16:0/3988890813 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3531 (secure 0 0 0) 0x7f24c0056c70 con 0x7f24d80b7000 2024-04-26T22:22:20.874 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:20.874 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:22:06.956001+0000","modified":"2024-04-26T22:22:09.969290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/3696570789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3696570789},{"type":"v1","addr":"172.21.15.16:6833","nonce":3696570789}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4980,"qdb_cluster":[4980]},"id":2}]} 2024-04-26T22:22:20.874 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 msgr2=0x7f24b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 0x7f24b406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24c80af000 tx=0x7f24c80a7070 comp rx=0 tx=0).stop 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 msgr2=0x7f24d8132990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f24c000e960 tx=0x7f24c000ee20 comp rx=0 tx=0).stop 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 shutdown_connections 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24b4068380 0x7f24b406a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d8142490 0x7f24d81e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24d80b7000 0x7f24d8132990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 --2- 172.21.15.16:0/3988890813 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24d806d1d0 0x7f24d80bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 >> 172.21.15.16:0/3988890813 conn(0x7f24d806f3d0 msgr2=0x7f24d80bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 shutdown_connections 2024-04-26T22:22:20.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:20.869+0000 7f24ddc00640 1 -- 172.21.15.16:0/3988890813 wait complete. 2024-04-26T22:22:20.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:21.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 Processor -- start 2024-04-26T22:22:21.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 -- start start 2024-04-26T22:22:21.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 0x7f1924140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19240b0ac0 0x7f19241405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192406e830 con 0x7f192406e450 2024-04-26T22:22:21.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f19240b3310 con 0x7f19240b0ac0 2024-04-26T22:22:21.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f192b600640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1924070790 con 0x7f19240b58d0 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19240b0ac0 0x7f19241405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19240b0ac0 0x7f19241405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57310/0 (socket says 172.21.15.16:57310) 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 -- 172.21.15.16:0/4044064104 learned_addr learned my addr 172.21.15.16:0/4044064104 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f191be00640 1 --2- 172.21.15.16:0/4044064104 >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 0x7f1924140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 -- 172.21.15.16:0/4044064104 >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 msgr2=0x7f1924140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 --2- 172.21.15.16:0/4044064104 >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 0x7f1924140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 -- 172.21.15.16:0/4044064104 >> v1:172.21.15.195:6789/0 conn(0x7f192406e450 legacy=0x7f19240b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f1929600640 1 -- 172.21.15.16:0/4044064104 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240b5f00 con 0x7f19240b0ac0 2024-04-26T22:22:21.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.029+0000 7f191be00640 1 --2- 172.21.15.16:0/4044064104 >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 0x7f1924140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:21.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f1929600640 1 --2- 172.21.15.16:0/4044064104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19240b0ac0 0x7f19241405a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f19240b3490 tx=0x7f191c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89d4444b7688a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f1923e00640 1 -- 172.21.15.16:0/4044064104 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a57b0 con 0x7f19240b0ac0 2024-04-26T22:22:21.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f1923e00640 1 -- 172.21.15.16:0/4044064104 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c0a5950 con 0x7f19240b0ac0 2024-04-26T22:22:21.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f1923e00640 1 -- 172.21.15.16:0/4044064104 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a5d20 con 0x7f19240b0ac0 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 -- 172.21.15.16:0/4044064104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19240b0ac0 msgr2=0x7f19241405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 --2- 172.21.15.16:0/4044064104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19240b0ac0 0x7f19241405a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f19240b3490 tx=0x7f191c01c8f0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 -- 172.21.15.16:0/4044064104 shutdown_connections 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 --2- 172.21.15.16:0/4044064104 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19240b0ac0 0x7f19241405a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 --2- 172.21.15.16:0/4044064104 >> v2:172.21.15.195:3300/0 conn(0x7f19240b58d0 0x7f1924140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 -- 172.21.15.16:0/4044064104 >> 172.21.15.16:0/4044064104 conn(0x7f19240b6620 msgr2=0x7f19240b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 -- 172.21.15.16:0/4044064104 shutdown_connections 2024-04-26T22:22:21.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.033+0000 7f192b600640 1 -- 172.21.15.16:0/4044064104 wait complete. 2024-04-26T22:22:21.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 Processor -- start 2024-04-26T22:22:21.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- start start 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 0x7f19240724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240b58d0 0x7f19241e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1924153700 con 0x7f192406e450 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1924153580 con 0x7f19240b58d0 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1924153880 con 0x7f19240b0ac0 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57316/0 (socket says 172.21.15.16:57316) 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 -- 172.21.15.16:0/553765323 learned_addr learned my addr 172.21.15.16:0/553765323 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:21.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1929600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240b58d0 0x7f19241e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f191be00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 0x7f19240724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 -- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 msgr2=0x7f19240724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 0x7f19240724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 -- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240b58d0 msgr2=0x7f19241e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240b58d0 0x7f19241e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 -- 172.21.15.16:0/553765323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924148160 con 0x7f192406e450 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f191be00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 0x7f19240724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1928c00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f191400c480 tx=0x7f191400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914012830 con 0x7f192406e450 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914017070 con 0x7f192406e450 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914012c30 con 0x7f192406e450 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1924148440 con 0x7f192406e450 2024-04-26T22:22:21.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.037+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1924073490 con 0x7f192406e450 2024-04-26T22:22:21.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1924069530 con 0x7f192406e450 2024-04-26T22:22:21.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f191401c460 con 0x7f192406e450 2024-04-26T22:22:21.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f1921600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 0x7f190006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f19140866b0 con 0x7f192406e450 2024-04-26T22:22:21.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f191be00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 0x7f190006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.041+0000 7f191be00640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 0x7f190006a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1924072210 tx=0x7f190c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.045+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1914056d00 con 0x7f192406e450 2024-04-26T22:22:21.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.209+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f192414a680 con 0x7f192406e450 2024-04-26T22:22:21.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f1921600640 1 -- 172.21.15.16:0/553765323 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16657 (secure 0 0 0) 0x7f1914056600 con 0x7f192406e450 2024-04-26T22:22:21.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:21.218 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:08.552305+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:22:04.803346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T22:22:05.921975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:21.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 msgr2=0x7f190006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 0x7f190006a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1924072210 tx=0x7f190c008040 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 msgr2=0x7f1924136da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f191400c480 tx=0x7f191400c940 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 shutdown_connections 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f1900068380 0x7f190006a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f19240b58d0 0x7f19241e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f19240b0ac0 0x7f19240724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 --2- 172.21.15.16:0/553765323 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f192406e450 0x7f1924136da0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 >> 172.21.15.16:0/553765323 conn(0x7f19240b6620 msgr2=0x7f19241441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 shutdown_connections 2024-04-26T22:22:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.213+0000 7f192b600640 1 -- 172.21.15.16:0/553765323 wait complete. 2024-04-26T22:22:21.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:22:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 Processor -- start 2024-04-26T22:22:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 -- start start 2024-04-26T22:22:21.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8075760 0x7f8fe81466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fe80b1a60 0x7f8fe80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe80b45b0 con 0x7f8fe8146be0 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe80b4030 con 0x7f8fe80b1a60 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fee600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe8075b40 con 0x7f8fe8075760 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fe80b1a60 0x7f8fe80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fe80b1a60 0x7f8fe80b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57326/0 (socket says 172.21.15.16:57326) 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 -- 172.21.15.16:0/3427576529 learned_addr learned my addr 172.21.15.16:0/3427576529 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fed200640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8075760 0x7f8fe81466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 -- 172.21.15.16:0/3427576529 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8075760 msgr2=0x7f8fe81466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8075760 0x7f8fe81466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 -- 172.21.15.16:0/3427576529 >> v1:172.21.15.16:6789/0 conn(0x7f8fe8146be0 legacy=0x7f8fe814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.377+0000 7f8fdfe00640 1 -- 172.21.15.16:0/3427576529 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80b42d0 con 0x7f8fe80b1a60 2024-04-26T22:22:21.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fdfe00640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe80b1a60 0x7f8fe80b2060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be3791cf6bd44d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fe7e00640 1 -- 172.21.15.16:0/3427576529 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00b2070 con 0x7f8fe80b1a60 2024-04-26T22:22:21.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fe7e00640 1 -- 172.21.15.16:0/3427576529 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd00a9070 con 0x7f8fe80b1a60 2024-04-26T22:22:21.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fe7e00640 1 -- 172.21.15.16:0/3427576529 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00ad880 con 0x7f8fe80b1a60 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 -- 172.21.15.16:0/3427576529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe80b1a60 msgr2=0x7f8fe80b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe80b1a60 0x7f8fe80b2060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd001c560 comp rx=0 tx=0).stop 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 -- 172.21.15.16:0/3427576529 shutdown_connections 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe80b1a60 0x7f8fe80b2060 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 --2- 172.21.15.16:0/3427576529 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8075760 0x7f8fe81466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 -- 172.21.15.16:0/3427576529 >> 172.21.15.16:0/3427576529 conn(0x7f8fe806ca00 msgr2=0x7f8fe80ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 -- 172.21.15.16:0/3427576529 shutdown_connections 2024-04-26T22:22:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.381+0000 7f8fee600640 1 -- 172.21.15.16:0/3427576529 wait complete. 2024-04-26T22:22:21.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 Processor -- start 2024-04-26T22:22:21.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- start start 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 0x7f8fe8139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8146be0 0x7f8fe80b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe815a150 con 0x7f8fe81e90a0 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8159fd0 con 0x7f8fe8075760 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe815a2d0 con 0x7f8fe8146be0 2024-04-26T22:22:21.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57330/0 (socket says 172.21.15.16:57330) 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 -- 172.21.15.16:0/3637753224 learned_addr learned my addr 172.21.15.16:0/3637753224 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fdfe00640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8146be0 0x7f8fe80b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fed200640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 0x7f8fe8139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 -- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8146be0 msgr2=0x7f8fe80b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8146be0 0x7f8fe80b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 -- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 msgr2=0x7f8fe8139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 0x7f8fe8139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 -- 172.21.15.16:0/3637753224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80b9790 con 0x7f8fe81e90a0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fed200640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 0x7f8fe8139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fedc00640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c730 tx=0x7f8fe000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0003b80 con 0x7f8fe81e90a0 2024-04-26T22:22:21.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe0003d20 con 0x7f8fe81e90a0 2024-04-26T22:22:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0005310 con 0x7f8fe81e90a0 2024-04-26T22:22:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe80b9a70 con 0x7f8fe81e90a0 2024-04-26T22:22:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81e88a0 con 0x7f8fe81e90a0 2024-04-26T22:22:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.385+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe80506d0 con 0x7f8fe81e90a0 2024-04-26T22:22:21.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.389+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8fe00056c0 con 0x7f8fe81e90a0 2024-04-26T22:22:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.389+0000 7f8fe5600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 0x7f8fc406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.389+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8fe00869e0 con 0x7f8fe81e90a0 2024-04-26T22:22:21.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.389+0000 7f8fed200640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 0x7f8fc406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.389+0000 7f8fed200640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 0x7f8fc406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fe81393a0 tx=0x7f8fd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.393+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8fe0056f90 con 0x7f8fe81e90a0 2024-04-26T22:22:21.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.593+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8fe80b8660 con 0x7f8fe81e90a0 2024-04-26T22:22:21.598 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-26T22:22:21.593+0000 7fd560a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:22:21.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.593+0000 7f8fe5600640 1 -- 172.21.15.16:0/3637753224 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f8fe0056890 con 0x7f8fe81e90a0 2024-04-26T22:22:21.600 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:22:21.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 msgr2=0x7f8fc406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 0x7f8fc406a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fe81393a0 tx=0x7f8fd8008040 comp rx=0 tx=0).stop 2024-04-26T22:22:21.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 msgr2=0x7f8fe81e5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c730 tx=0x7f8fe000cbf0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 shutdown_connections 2024-04-26T22:22:21.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f8fc4068380 0x7f8fc406a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fe81e90a0 0x7f8fe81e5920 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8fe8146be0 0x7f8fe80b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 --2- 172.21.15.16:0/3637753224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8fe8075760 0x7f8fe8139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 >> 172.21.15.16:0/3637753224 conn(0x7f8fe806ca00 msgr2=0x7f8fe80b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:21.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 shutdown_connections 2024-04-26T22:22:21.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.597+0000 7f8fee600640 1 -- 172.21.15.16:0/3637753224 wait complete. 2024-04-26T22:22:21.609 INFO:tasks.ceph.mds.a.smithi016.stderr: -2426> 2024-04-26T22:22:11.526+0000 7fe022800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:22:21.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:22:21.658 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-26T22:22:21.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 Processor -- start 2024-04-26T22:22:21.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 -- start start 2024-04-26T22:22:21.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3e1806e410 0x7f3e180b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3e18149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1806e7f0 con 0x7f3e1813eec0 2024-04-26T22:22:21.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3e18070a40 con 0x7f3e1806e410 2024-04-26T22:22:21.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e1d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3e18070760 con 0x7f3e181465c0 2024-04-26T22:22:21.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e17400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3e1813eec0 0x7f3e1813f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47918/0 (socket says 172.21.15.16:47918) 2024-04-26T22:22:21.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.765+0000 7f3e17400640 1 -- 172.21.15.16:0/2451200049 learned_addr learned my addr 172.21.15.16:0/2451200049 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3e18149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16a00640 1 --2- 172.21.15.16:0/2451200049 >> v2:172.21.15.195:3300/0 conn(0x7f3e1806e410 0x7f3e180b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380744672 0 0) 0x7f3e1806e7f0 con 0x7f3e1813eec0 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dfc005740 con 0x7f3e1813eec0 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3802480949 0 0) 0x7f3dfc005740 con 0x7f3e1813eec0 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 msgr2=0x7f3e18149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3e18149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 >> v2:172.21.15.195:3300/0 conn(0x7f3e1806e410 msgr2=0x7f3e180b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 --2- 172.21.15.16:0/2451200049 >> v2:172.21.15.195:3300/0 conn(0x7f3e1806e410 0x7f3e180b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e18148860 con 0x7f3e1813eec0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f3e10001a00 con 0x7f3e1813eec0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 >> v1:172.21.15.16:6789/0 conn(0x7f3e1813eec0 legacy=0x7f3e1813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3dfc005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dfc006150 0x7f3dfc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18070a40 con 0x7f3dfc006150 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18070760 con 0x7f3dfc006f60 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc00dc30 con 0x7f3e181465c0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dfc006150 0x7f3dfc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16a00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3dfc005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e17400640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 -- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 msgr2=0x7f3dfc005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3dfc005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 -- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dfc006f60 msgr2=0x7f3dfc0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:21.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3dfc006f60 0x7f3dfc0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e0fe00640 1 -- 172.21.15.16:0/2451200049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc005740 con 0x7f3dfc006150 2024-04-26T22:22:21.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.769+0000 7f3e16a00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3e181465c0 0x7f3dfc005bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dfc006150 0x7f3dfc006a20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ae0 tx=0x7f3e0001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e585313300b10f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000096b0 con 0x7f3dfc006150 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e000a6420 con 0x7f3dfc006150 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e16000640 1 -- 172.21.15.16:0/2451200049 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000a6810 con 0x7f3dfc006150 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- 172.21.15.16:0/2451200049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dfc006150 msgr2=0x7f3dfc006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 --2- 172.21.15.16:0/2451200049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dfc006150 0x7f3dfc006a20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ae0 tx=0x7f3e0001ca30 comp rx=0 tx=0).stop 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e17400640 1 -- 172.21.15.16:0/2451200049 reap_dead start 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- 172.21.15.16:0/2451200049 shutdown_connections 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- 172.21.15.16:0/2451200049 >> 172.21.15.16:0/2451200049 conn(0x7f3e180b6590 msgr2=0x7f3e180b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- 172.21.15.16:0/2451200049 shutdown_connections 2024-04-26T22:22:21.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- 172.21.15.16:0/2451200049 wait complete. 2024-04-26T22:22:21.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 Processor -- start 2024-04-26T22:22:21.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- start start 2024-04-26T22:22:21.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dfc006150 0x7f3e181dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 0x7f3e181e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3e180b5030 con 0x7f3e18142f60 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3e180b4eb0 con 0x7f3e181dffe0 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e1d800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3e180b51b0 con 0x7f3dfc006150 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57372/0 (socket says 172.21.15.16:57372) 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1121652760 learned_addr learned my addr 172.21.15.16:0/1121652760 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e16a00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dfc006150 0x7f3e181dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e17400640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 0x7f3e181e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dfc006150 msgr2=0x7f3e181dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dfc006150 0x7f3e181dd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 msgr2=0x7f3e181e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 0x7f3e181e0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e0fe00640 1 -- 172.21.15.16:0/1121652760 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181dcb80 con 0x7f3e18142f60 2024-04-26T22:22:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.773+0000 7f3e17400640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 0x7f3e181e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0fe00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ae0 tx=0x7f3dfc007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000be070 con 0x7f3e18142f60 2024-04-26T22:22:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0000f000 con 0x7f3e18142f60 2024-04-26T22:22:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e18143d00 con 0x7f3e18142f60 2024-04-26T22:22:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000a6df0 con 0x7f3e18142f60 2024-04-26T22:22:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e18144250 con 0x7f3e18142f60 2024-04-26T22:22:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e18069530 con 0x7f3e18142f60 2024-04-26T22:22:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e000c1070 con 0x7f3e18142f60 2024-04-26T22:22:21.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 0x7f3df406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:21.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f3e00120210 con 0x7f3e18142f60 2024-04-26T22:22:21.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.777+0000 7f3e16a00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 0x7f3df406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:21.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.781+0000 7f3e16a00640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 0x7f3df406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009be0 tx=0x7f3e08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:21.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.781+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e000ac020 con 0x7f3e18142f60 2024-04-26T22:22:21.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:21.981+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3e1814b810 con 0x7f3e18142f60 2024-04-26T22:22:22.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e0ea00640 1 -- 172.21.15.16:0/1121652760 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f3e00016780 con 0x7f3e18142f60 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 msgr2=0x7f3df406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 0x7f3df406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009be0 tx=0x7f3e08008040 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 msgr2=0x7f3e1813db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ae0 tx=0x7f3dfc007a50 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 shutdown_connections 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3df40683b0 0x7f3df406a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e181dffe0 0x7f3e181e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e18142f60 0x7f3e1813db90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 --2- 172.21.15.16:0/1121652760 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3dfc006150 0x7f3e181dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 >> 172.21.15.16:0/1121652760 conn(0x7f3e180b6590 msgr2=0x7f3e1806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 shutdown_connections 2024-04-26T22:22:22.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.601+0000 7f3e1d800640 1 -- 172.21.15.16:0/1121652760 wait complete. 2024-04-26T22:22:22.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:22:22.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 Processor -- start 2024-04-26T22:22:22.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 -- start start 2024-04-26T22:22:22.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bf4073940 0x7f7bf4146800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 0x7f7bf414a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf406e830 con 0x7f7bf4068b40 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf414a7d0 con 0x7f7bf4073940 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bfb400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf4073d20 con 0x7f7bf4149e40 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bf4073940 0x7f7bf4146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7bf4073940 0x7f7bf4146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57384/0 (socket says 172.21.15.16:57384) 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 -- 172.21.15.16:0/1627274355 learned_addr learned my addr 172.21.15.16:0/1627274355 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:22.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf9400640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 0x7f7bf414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 -- 172.21.15.16:0/1627274355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 msgr2=0x7f7bf414a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:22.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 0x7f7bf414a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 -- 172.21.15.16:0/1627274355 >> v1:172.21.15.195:6789/0 conn(0x7f7bf4068b40 legacy=0x7f7bf4140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf8a00640 1 -- 172.21.15.16:0/1627274355 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf4147200 con 0x7f7bf4073940 2024-04-26T22:22:22.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.813+0000 7f7bf9400640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 0x7f7bf414a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:22.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bf8a00640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4073940 0x7f7bf4146800 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1e7440c24c513d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:22.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bf3e00640 1 -- 172.21.15.16:0/1627274355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40ab650 con 0x7f7bf4073940 2024-04-26T22:22:22.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bf3e00640 1 -- 172.21.15.16:0/1627274355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be40b0070 con 0x7f7bf4073940 2024-04-26T22:22:22.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bf3e00640 1 -- 172.21.15.16:0/1627274355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40aba10 con 0x7f7bf4073940 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 -- 172.21.15.16:0/1627274355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4073940 msgr2=0x7f7bf4146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4073940 0x7f7bf4146800 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009870 tx=0x7f7be401c560 comp rx=0 tx=0).stop 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 -- 172.21.15.16:0/1627274355 shutdown_connections 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4149e40 0x7f7bf414a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1627274355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4073940 0x7f7bf4146800 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 -- 172.21.15.16:0/1627274355 >> 172.21.15.16:0/1627274355 conn(0x7f7bf406c400 msgr2=0x7f7bf406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 -- 172.21.15.16:0/1627274355 shutdown_connections 2024-04-26T22:22:22.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.817+0000 7f7bfb400640 1 -- 172.21.15.16:0/1627274355 wait complete. 2024-04-26T22:22:22.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 Processor -- start 2024-04-26T22:22:22.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- start start 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4068b40 0x7f7bf4139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 0x7f7bf40a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf41535b0 con 0x7f7bf4149e40 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf4153430 con 0x7f7bf4073940 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf4153730 con 0x7f7bf4068b40 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57396/0 (socket says 172.21.15.16:57396) 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 -- 172.21.15.16:0/1714291604 learned_addr learned my addr 172.21.15.16:0/1714291604 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bebe00640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 0x7f7bf40a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf8a00640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4068b40 0x7f7bf4139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 -- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4068b40 msgr2=0x7f7bf4139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4068b40 0x7f7bf4139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 -- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 msgr2=0x7f7bf40a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:22.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 0x7f7bf40a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:22.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 -- 172.21.15.16:0/1714291604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf4134bf0 con 0x7f7bf4149e40 2024-04-26T22:22:22.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bebe00640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 0x7f7bf40a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf9400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7bec007e70 tx=0x7f7bec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec01a070 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec003bc0 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec004030 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf4135750 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf4135a30 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.821+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4135540 con 0x7f7bf4149e40 2024-04-26T22:22:22.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.825+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bec01d070 con 0x7f7bf4149e40 2024-04-26T22:22:22.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.825+0000 7f7bf1600640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:22.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.825+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f7bec086cb0 con 0x7f7bf4149e40 2024-04-26T22:22:22.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.825+0000 7f7bf8a00640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:22.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.825+0000 7f7bf8a00640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7be40af000 tx=0x7f7be40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:22.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.829+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7bec010070 con 0x7f7bf4149e40 2024-04-26T22:22:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:22.993+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7bf4134dc0 con 0x7f7bf4149e40 2024-04-26T22:22:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.601+0000 7f7bf1600640 1 -- 172.21.15.16:0/1714291604 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7f7bec057200 con 0x7f7bf4149e40 2024-04-26T22:22:23.607 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 msgr2=0x7f7bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7be40af000 tx=0x7f7be40a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 msgr2=0x7f7bf41e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7bec007e70 tx=0x7f7bec00d4a0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 shutdown_connections 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bf4149e40 0x7f7bf41e4550 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bf4073940 0x7f7bf40a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 --2- 172.21.15.16:0/1714291604 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7bf4068b40 0x7f7bf4139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 >> 172.21.15.16:0/1714291604 conn(0x7f7bf406c400 msgr2=0x7f7bf40ba270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:23.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 shutdown_connections 2024-04-26T22:22:23.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.605+0000 7f7bfb400640 1 -- 172.21.15.16:0/1714291604 wait complete. 2024-04-26T22:22:23.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:22:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 Processor -- start 2024-04-26T22:22:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 -- start start 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 0x7f6f10140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6f101498d0 0x7f6f10150c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f100b3870 con 0x7f6f100b3490 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f6f10070560 con 0x7f6f101498d0 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f15e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6f10070840 con 0x7f6f100b6110 2024-04-26T22:22:23.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6f100b3490 0x7f6f100b5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47928/0 (socket says 172.21.15.16:47928) 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0ea00640 1 -- 172.21.15.16:0/2432897841 learned_addr learned my addr 172.21.15.16:0/2432897841 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0e000640 1 --2- 172.21.15.16:0/2432897841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 0x7f6f10140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0f400640 1 --2- 172.21.15.16:0/2432897841 >> v2:172.21.15.195:3300/0 conn(0x7f6f101498d0 0x7f6f10150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579058758 0 0) 0x7f6f100b3870 con 0x7f6f100b3490 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef4003530 con 0x7f6f100b3490 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0e000640 1 -- 172.21.15.16:0/2432897841 >> v2:172.21.15.195:3300/0 conn(0x7f6f101498d0 msgr2=0x7f6f10150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0e000640 1 --2- 172.21.15.16:0/2432897841 >> v2:172.21.15.195:3300/0 conn(0x7f6f101498d0 0x7f6f10150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946360527 0 0) 0x7f6ef4003530 con 0x7f6f100b3490 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0e000640 1 -- 172.21.15.16:0/2432897841 >> v1:172.21.15.16:6789/0 conn(0x7f6f100b3490 legacy=0x7f6f100b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.777+0000 7f6f0e000640 1 -- 172.21.15.16:0/2432897841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f100b0bd0 con 0x7f6f100b6110 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f0e000640 1 --2- 172.21.15.16:0/2432897841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 0x7f6f10140280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097c0 tx=0x7f6efc01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e3a7921290edf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b0070 con 0x7f6f100b6110 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc0ab400 con 0x7f6f100b6110 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f0d600640 1 -- 172.21.15.16:0/2432897841 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00001680 con 0x7f6f100b6110 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 -- 172.21.15.16:0/2432897841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 msgr2=0x7f6f10140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 --2- 172.21.15.16:0/2432897841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 0x7f6f10140280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0097c0 tx=0x7f6efc01c330 comp rx=0 tx=0).stop 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 -- 172.21.15.16:0/2432897841 shutdown_connections 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 --2- 172.21.15.16:0/2432897841 >> v2:172.21.15.195:3300/0 conn(0x7f6f101498d0 0x7f6f10150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 --2- 172.21.15.16:0/2432897841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b6110 0x7f6f10140280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 -- 172.21.15.16:0/2432897841 >> 172.21.15.16:0/2432897841 conn(0x7f6f100b6620 msgr2=0x7f6f100b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 -- 172.21.15.16:0/2432897841 shutdown_connections 2024-04-26T22:22:23.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.781+0000 7f6f15e00640 1 -- 172.21.15.16:0/2432897841 wait complete. 2024-04-26T22:22:23.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 Processor -- start 2024-04-26T22:22:23.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- start start 2024-04-26T22:22:23.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b3490 0x7f6f100b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 0x7f6f1013bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10153bd0 con 0x7f6f100b6110 2024-04-26T22:22:23.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100b5ad0 con 0x7f6f101498d0 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f6f10153d50 con 0x7f6f100b3490 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57410/0 (socket says 172.21.15.16:57410) 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 -- 172.21.15.16:0/985689625 learned_addr learned my addr 172.21.15.16:0/985689625 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0ea00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b3490 0x7f6f100b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0f400640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 0x7f6f1013bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 -- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b3490 msgr2=0x7f6f100b8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b3490 0x7f6f100b8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 -- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 msgr2=0x7f6f1013bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 0x7f6f1013bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 -- 172.21.15.16:0/985689625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f101463c0 con 0x7f6f100b6110 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0f400640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 0x7f6f1013bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f0e000640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0ae040 tx=0x7f6efc0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0ba070 con 0x7f6f100b6110 2024-04-26T22:22:23.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc003bd0 con 0x7f6f100b6110 2024-04-26T22:22:23.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f10144510 con 0x7f6f100b6110 2024-04-26T22:22:23.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b0040 con 0x7f6f100b6110 2024-04-26T22:22:23.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f100b96c0 con 0x7f6f100b6110 2024-04-26T22:22:23.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.785+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f10069530 con 0x7f6f100b6110 2024-04-26T22:22:23.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.789+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6efc0bd070 con 0x7f6f100b6110 2024-04-26T22:22:23.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.789+0000 7f6f07400640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:23.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.789+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5357+0+0 (secure 0 0 0) 0x7f6efc11fce0 con 0x7f6f100b6110 2024-04-26T22:22:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.789+0000 7f6f0ea00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:23.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.789+0000 7f6f0ea00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 0x7f6ef006a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001330 tx=0x7f6f000012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:23.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.793+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6efc015fb0 con 0x7f6f100b6110 2024-04-26T22:22:23.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:23.957+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f10070c90 con 0x7f6f100b6110 2024-04-26T22:22:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.609+0000 7f6f07400640 1 -- 172.21.15.16:0/985689625 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7f6efc0efd10 con 0x7f6f100b6110 2024-04-26T22:22:24.613 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-26T22:22:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.613+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 msgr2=0x7f6ef006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.613+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 0x7f6ef006a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f00001330 tx=0x7f6f000012c0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.613+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 msgr2=0x7f6f10144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.613+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0ae040 tx=0x7f6efc0190d0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 shutdown_connections 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6ef00683b0 0x7f6ef006a870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6f101498d0 0x7f6f1013bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100b6110 0x7f6f10144a70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 --2- 172.21.15.16:0/985689625 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6f100b3490 0x7f6f100b8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 >> 172.21.15.16:0/985689625 conn(0x7f6f100b6620 msgr2=0x7f6f100b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:24.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 shutdown_connections 2024-04-26T22:22:24.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.617+0000 7f6f15e00640 1 -- 172.21.15.16:0/985689625 wait complete. 2024-04-26T22:22:24.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:22:24.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 Processor -- start 2024-04-26T22:22:24.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 -- start start 2024-04-26T22:22:24.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fdb5406e410 0x7fdb5413ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb540b0a30 0x7fdb54140510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb54070480 con 0x7fdb541464e0 2024-04-26T22:22:24.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdb54070a60 con 0x7fdb540b0a30 2024-04-26T22:22:24.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb5c200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fdb540718a0 con 0x7fdb5406e410 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb540b0a30 0x7fdb54140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb540b0a30 0x7fdb54140510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41244/0 (socket says 172.21.15.16:41244) 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 -- 172.21.15.16:0/1624471717 learned_addr learned my addr 172.21.15.16:0/1624471717 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb59800640 1 --2- 172.21.15.16:0/1624471717 >> v2:172.21.15.195:3300/0 conn(0x7fdb5406e410 0x7fdb5413ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 -- 172.21.15.16:0/1624471717 >> v2:172.21.15.195:3300/0 conn(0x7fdb5406e410 msgr2=0x7fdb5413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 --2- 172.21.15.16:0/1624471717 >> v2:172.21.15.195:3300/0 conn(0x7fdb5406e410 0x7fdb5413ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 -- 172.21.15.16:0/1624471717 >> v1:172.21.15.195:6789/0 conn(0x7fdb541464e0 legacy=0x7fdb54146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:24.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.789+0000 7fdb58e00640 1 -- 172.21.15.16:0/1624471717 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5406e7f0 con 0x7fdb540b0a30 2024-04-26T22:22:24.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb58e00640 1 --2- 172.21.15.16:0/1624471717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb540b0a30 0x7fdb54140510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b3910 tx=0x7fdb4001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b802fc92bb7b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:24.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb53e00640 1 -- 172.21.15.16:0/1624471717 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400ab640 con 0x7fdb540b0a30 2024-04-26T22:22:24.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb53e00640 1 -- 172.21.15.16:0/1624471717 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb400b0070 con 0x7fdb540b0a30 2024-04-26T22:22:24.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb53e00640 1 -- 172.21.15.16:0/1624471717 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb400aba00 con 0x7fdb540b0a30 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- 172.21.15.16:0/1624471717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb540b0a30 msgr2=0x7fdb54140510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 --2- 172.21.15.16:0/1624471717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb540b0a30 0x7fdb54140510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b3910 tx=0x7fdb4001c420 comp rx=0 tx=0).stop 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- 172.21.15.16:0/1624471717 shutdown_connections 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 --2- 172.21.15.16:0/1624471717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb540b0a30 0x7fdb54140510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 --2- 172.21.15.16:0/1624471717 >> v2:172.21.15.195:3300/0 conn(0x7fdb5406e410 0x7fdb5413ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- 172.21.15.16:0/1624471717 >> 172.21.15.16:0/1624471717 conn(0x7fdb540b6590 msgr2=0x7fdb540b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- 172.21.15.16:0/1624471717 shutdown_connections 2024-04-26T22:22:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- 172.21.15.16:0/1624471717 wait complete. 2024-04-26T22:22:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 Processor -- start 2024-04-26T22:22:24.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.793+0000 7fdb5c200640 1 -- start start 2024-04-26T22:22:24.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5406e410 0x7fdb54073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb540b0a30 0x7fdb541de870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdb54153520 con 0x7fdb541464e0 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fdb541533a0 con 0x7fdb5406e410 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fdb541536a0 con 0x7fdb540b0a30 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41252/0 (socket says 172.21.15.16:41252) 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 -- 172.21.15.16:0/2786649191 learned_addr learned my addr 172.21.15.16:0/2786649191 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb59800640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5406e410 0x7fdb54073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb58e00640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb540b0a30 0x7fdb541de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 -- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb540b0a30 msgr2=0x7fdb541de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb540b0a30 0x7fdb541de870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 -- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5406e410 msgr2=0x7fdb54073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5406e410 0x7fdb54073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 -- 172.21.15.16:0/2786649191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb540ab760 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5a200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b970 tx=0x7fdb4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c019070 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00cb40 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c014440 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb54073ed0 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb541508a0 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb54069530 con 0x7fdb541464e0 2024-04-26T22:22:24.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.797+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb4c01c070 con 0x7fdb541464e0 2024-04-26T22:22:24.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.801+0000 7fdb51600640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 0x7fdb3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:24.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.801+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fdb4c086240 con 0x7fdb541464e0 2024-04-26T22:22:24.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.801+0000 7fdb59800640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 0x7fdb3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:24.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.801+0000 7fdb59800640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 0x7fdb3406a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b05f0 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:24.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.805+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdb4c0564a0 con 0x7fdb541464e0 2024-04-26T22:22:24.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.969+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fdb5413fed0 con 0x7fdb541464e0 2024-04-26T22:22:24.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.973+0000 7fdb51600640 1 -- 172.21.15.16:0/2786649191 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fdb4c05a7a0 con 0x7fdb541464e0 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 msgr2=0x7fdb3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 0x7fdb3406a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb540b05f0 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 msgr2=0x7fdb541dedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b970 tx=0x7fdb4c00be30 comp rx=0 tx=0).stop 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 shutdown_connections 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fdb340683b0 0x7fdb3406a870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb541464e0 0x7fdb541dedb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fdb540b0a30 0x7fdb541de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 --2- 172.21.15.16:0/2786649191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5406e410 0x7fdb54073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:24.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 >> 172.21.15.16:0/2786649191 conn(0x7fdb540b6590 msgr2=0x7fdb5413e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:24.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 shutdown_connections 2024-04-26T22:22:24.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:24.977+0000 7fdb5c200640 1 -- 172.21.15.16:0/2786649191 wait complete. 2024-04-26T22:22:25.001 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-04-26T22:22:25.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 Processor -- start 2024-04-26T22:22:25.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 -- start start 2024-04-26T22:22:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f6504148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f65040b8b60 0x7f6504142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f65040b7460 0x7f6504142790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f650406caf0 con 0x7f65040b8b60 2024-04-26T22:22:25.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f65040b8650 con 0x7f65040b7460 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6509800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f65040b6e40 con 0x7f65040b7b10 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f65040b8b60 0x7f6504142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f6504148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f65040b8b60 0x7f6504142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41262/0 (socket says 172.21.15.16:41262) 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 -- 172.21.15.16:0/745089163 learned_addr learned my addr 172.21.15.16:0/745089163 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6508e00640 1 --2- 172.21.15.16:0/745089163 >> v2:172.21.15.195:3300/0 conn(0x7f65040b7460 0x7f6504142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 -- 172.21.15.16:0/745089163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 msgr2=0x7f6504148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 --2- 172.21.15.16:0/745089163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f6504148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 -- 172.21.15.16:0/745089163 >> v2:172.21.15.195:3300/0 conn(0x7f65040b7460 msgr2=0x7f6504142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:25.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 --2- 172.21.15.16:0/745089163 >> v2:172.21.15.195:3300/0 conn(0x7f65040b7460 0x7f6504142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.137+0000 7f6503400640 1 -- 172.21.15.16:0/745089163 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65040b7120 con 0x7f65040b8b60 2024-04-26T22:22:25.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.141+0000 7f6503400640 1 --2- 172.21.15.16:0/745089163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b8b60 0x7f6504142250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65040b9aa0 tx=0x7f64f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e288411d374fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:25.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.141+0000 7f6502a00640 1 -- 172.21.15.16:0/745089163 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00b2070 con 0x7f65040b8b60 2024-04-26T22:22:25.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.141+0000 7f6502a00640 1 -- 172.21.15.16:0/745089163 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f00a9070 con 0x7f65040b8b60 2024-04-26T22:22:25.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.141+0000 7f6502a00640 1 -- 172.21.15.16:0/745089163 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f00ad880 con 0x7f65040b8b60 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- 172.21.15.16:0/745089163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b8b60 msgr2=0x7f6504142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 --2- 172.21.15.16:0/745089163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b8b60 0x7f6504142250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f65040b9aa0 tx=0x7f64f001c490 comp rx=0 tx=0).stop 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- 172.21.15.16:0/745089163 shutdown_connections 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 --2- 172.21.15.16:0/745089163 >> v2:172.21.15.195:3300/0 conn(0x7f65040b7460 0x7f6504142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 --2- 172.21.15.16:0/745089163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b8b60 0x7f6504142250 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 --2- 172.21.15.16:0/745089163 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f6504148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- 172.21.15.16:0/745089163 >> 172.21.15.16:0/745089163 conn(0x7f650406f500 msgr2=0x7f650406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:25.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- 172.21.15.16:0/745089163 shutdown_connections 2024-04-26T22:22:25.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- 172.21.15.16:0/745089163 wait complete. 2024-04-26T22:22:25.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 Processor -- start 2024-04-26T22:22:25.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.145+0000 7f6509800640 1 -- start start 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040b7460 0x7f65040bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f65040b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f650414c4c0 con 0x7f65040b30f0 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f650414c340 con 0x7f65040b7460 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f650414c640 con 0x7f65040b7b10 2024-04-26T22:22:25.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41274/0 (socket says 172.21.15.16:41274) 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 -- 172.21.15.16:0/3208701605 learned_addr learned my addr 172.21.15.16:0/3208701605 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6503400640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f65040b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 -- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 msgr2=0x7f65040b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f65040b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 -- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040b7460 msgr2=0x7f65040bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040b7460 0x7f65040bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 -- 172.21.15.16:0/3208701605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65040b4220 con 0x7f65040b30f0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6503400640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f65040b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6508e00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009d30 tx=0x7f64fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc018020 con 0x7f65040b30f0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc014480 con 0x7f65040b30f0 2024-04-26T22:22:25.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65040b54d0 con 0x7f65040b30f0 2024-04-26T22:22:25.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc014870 con 0x7f65040b30f0 2024-04-26T22:22:25.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6504143d70 con 0x7f65040b30f0 2024-04-26T22:22:25.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.149+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65040b44e0 con 0x7f65040b30f0 2024-04-26T22:22:25.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.153+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64fc01b020 con 0x7f65040b30f0 2024-04-26T22:22:25.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.153+0000 7f64fbe00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 0x7f64e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:25.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.153+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f64fc087110 con 0x7f65040b30f0 2024-04-26T22:22:25.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.153+0000 7f6503e00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 0x7f64e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:25.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.153+0000 7f6503e00640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 0x7f64e406a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64f40099c0 tx=0x7f64f4009480 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:25.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.157+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f64fc022070 con 0x7f65040b30f0 2024-04-26T22:22:25.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.377+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7f65040bca20 con 0x7f65040b30f0 2024-04-26T22:22:25.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.609+0000 7f64fbe00640 1 -- 172.21.15.16:0/3208701605 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v88) ==== 134+0+0 (secure 0 0 0) 0x7f64fc010040 con 0x7f65040b30f0 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 msgr2=0x7f64e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 0x7f64e406a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f64f40099c0 tx=0x7f64f4009480 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 msgr2=0x7f65041e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009d30 tx=0x7f64fc00c490 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 shutdown_connections 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f64e4068380 0x7f64e406a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f65040b30f0 0x7f65041e4620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f65040b7b10 0x7f65040b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 --2- 172.21.15.16:0/3208701605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65040b7460 0x7f65040bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 >> 172.21.15.16:0/3208701605 conn(0x7f650406f500 msgr2=0x7f65040723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 shutdown_connections 2024-04-26T22:22:25.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:25.613+0000 7f6509800640 1 -- 172.21.15.16:0/3208701605 wait complete. 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner: 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-04-26T22:22:25.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 127: 'cephfs-shell -b /tmp/test-cephfs_1b1iq2h' 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner:Ran 1 test in 39.744s 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner: 2024-04-26T22:22:25.640 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T22:22:25.641 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T22:22:25.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T22:22:25.642 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T22:22:25.642 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 127: 'cephfs-shell -b /tmp/test-cephfs_1b1iq2h' 2024-04-26T22:22:25.642 INFO:tasks.cephfs_test_runner: 2024-04-26T22:22:25.642 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-26T22:22:25.964 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=856dc7b9ecc44733bc9fc294b8def62f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-04-26T22:22:25.965 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T22:22:25.974 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T22:22:26.062 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T22:22:26.062 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T22:22:26.063 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:22:26.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353396k,nr_inodes=4088349,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9412 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-04-26T22:22:26.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:26.077 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-26T22:22:26.129 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:22:26.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:26.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:22:26.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:22:26.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-26T22:22:26.367 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T22:22:26.376 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T22:22:26.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:26.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 Processor -- start 2024-04-26T22:22:26.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 -- start start 2024-04-26T22:22:26.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f54600b8680 0x7f5460146380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54600b8dd0 con 0x7f5460073d90 2024-04-26T22:22:26.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5460149ea0 con 0x7f5460140880 2024-04-26T22:22:26.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f5466200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f54600b6b80 con 0x7f54600b8680 2024-04-26T22:22:26.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5460073d90 0x7f5460140170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36244/0 (socket says 172.21.15.16:36244) 2024-04-26T22:22:26.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 -- 172.21.15.16:0/1683056848 learned_addr learned my addr 172.21.15.16:0/1683056848 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545f400640 1 --2- 172.21.15.16:0/1683056848 >> v2:172.21.15.195:3300/0 conn(0x7f54600b8680 0x7f5460146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187917916 0 0) 0x7f54600b8dd0 con 0x7f5460073d90 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5444003530 con 0x7f5460073d90 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 605571636 0 0) 0x7f5444003530 con 0x7f5460073d90 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 >> v2:172.21.15.195:3300/0 conn(0x7f54600b8680 msgr2=0x7f5460146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 --2- 172.21.15.16:0/1683056848 >> v2:172.21.15.195:3300/0 conn(0x7f54600b8680 0x7f5460146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 >> v1:172.21.15.195:6789/0 conn(0x7f5460140880 legacy=0x7f5460150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54600b6db0 con 0x7f5460073d90 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f544c001680 con 0x7f5460073d90 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 >> v1:172.21.15.16:6789/0 conn(0x7f5460073d90 legacy=0x7f5460140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54440039c0 0x7f5444003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 0x7f5444004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f54440051d0 0x7f544400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f544400c140 con 0x7f5444004810 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f544400c2f0 con 0x7f54440039c0 2024-04-26T22:22:26.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f544400c4f0 con 0x7f54440051d0 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 0x7f5444004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545f400640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54440039c0 0x7f5444003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545fe00640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f54440051d0 0x7f544400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 -- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f54440051d0 msgr2=0x7f544400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f54440051d0 0x7f544400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 -- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54440039c0 msgr2=0x7f5444003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54440039c0 0x7f5444003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545ea00640 1 -- 172.21.15.16:0/1683056848 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5444003530 con 0x7f5444004810 2024-04-26T22:22:26.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.513+0000 7f545fe00640 1 -- 172.21.15.16:0/1683056848 reap_dead start 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f545ea00640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 0x7f5444004c90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c210 tx=0x7f544c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1158b0e4662862ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c007d40 con 0x7f5444004810 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c0a9070 con 0x7f5444004810 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f545e000640 1 -- 172.21.15.16:0/1683056848 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c005d80 con 0x7f5444004810 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 -- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 msgr2=0x7f5444004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 0x7f5444004c90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c210 tx=0x7f544c01cca0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 -- 172.21.15.16:0/1683056848 shutdown_connections 2024-04-26T22:22:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 --2- 172.21.15.16:0/1683056848 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5444004810 0x7f5444004c90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 -- 172.21.15.16:0/1683056848 >> 172.21.15.16:0/1683056848 conn(0x7f546006f3d0 msgr2=0x7f546006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:26.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 -- 172.21.15.16:0/1683056848 shutdown_connections 2024-04-26T22:22:26.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.517+0000 7f5466200640 1 -- 172.21.15.16:0/1683056848 wait complete. 2024-04-26T22:22:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 Processor -- start 2024-04-26T22:22:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- start start 2024-04-26T22:22:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5444004810 0x7f5460143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 0x7f54601e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5460072790 con 0x7f54601df660 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5460072610 con 0x7f54601e2880 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5460072910 con 0x7f5444004810 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41288/0 (socket says 172.21.15.16:41288) 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 -- 172.21.15.16:0/798789039 learned_addr learned my addr 172.21.15.16:0/798789039 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545f400640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5444004810 0x7f5460143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545fe00640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 0x7f54601e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 -- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5444004810 msgr2=0x7f5460143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5444004810 0x7f5460143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 -- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 msgr2=0x7f54601e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 0x7f54601e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 -- 172.21.15.16:0/798789039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54601e0000 con 0x7f54601df660 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545fe00640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 0x7f54601e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f545ea00640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f544c01c710 tx=0x7f5444005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c007d40 con 0x7f54601df660 2024-04-26T22:22:26.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544c000ee0 con 0x7f54601df660 2024-04-26T22:22:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54601d4e80 con 0x7f54601df660 2024-04-26T22:22:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c001660 con 0x7f54601df660 2024-04-26T22:22:26.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5460148790 con 0x7f54601df660 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.521+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54601d54b0 con 0x7f54601df660 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.525+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f544c007180 con 0x7f54601df660 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.525+0000 7f5457400640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 0x7f544006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.525+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f544c11fd60 con 0x7f54601df660 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.525+0000 7f545f400640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 0x7f544006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.525+0000 7f545f400640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 0x7f544006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54600519e0 tx=0x7f5450009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.529+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f544c0169b0 con 0x7f54601df660 2024-04-26T22:22:26.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5460069530 con 0x7f5440068380 2024-04-26T22:22:26.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5457400640 1 -- 172.21.15.16:0/798789039 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13470 (secure 0 0 0) 0x7f5460069530 con 0x7f5440068380 2024-04-26T22:22:26.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:26.699 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 msgr2=0x7f544006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 0x7f544006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54600519e0 tx=0x7f5450009190 comp rx=0 tx=0).stop 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 msgr2=0x7f54601dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f544c01c710 tx=0x7f5444005840 comp rx=0 tx=0).stop 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 shutdown_connections 2024-04-26T22:22:26.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5440068380 0x7f544006a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f54601e2880 0x7f54601e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54601df660 0x7f54601dfac0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 --2- 172.21.15.16:0/798789039 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5444004810 0x7f5460143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 >> 172.21.15.16:0/798789039 conn(0x7f546006f3d0 msgr2=0x7f546013ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 shutdown_connections 2024-04-26T22:22:26.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.693+0000 7f5466200640 1 -- 172.21.15.16:0/798789039 wait complete. 2024-04-26T22:22:26.719 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T22:22:26.115698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253444,"kb_used_data":4000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721276,"statfs":{"total":773094113280,"available":772834586624,"internally_reserved":0,"allocated":4096000,"data_stored":2291449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10891,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T22:22:22.111037+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:22.111037+0000","last_peered":"2024-04-26T22:22:22.111037+0000","last_clean":"2024-04-26T22:22:22.111037+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:22.111037+0000","last_undegraded":"2024-04-26T22:22:22.111037+0000","last_fullsized":"2024-04-26T22:22:22.111037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":135547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":356352,"data_stored":135513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":725811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:26.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:26.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.853+0000 7f5c80a00640 1 Processor -- start 2024-04-26T22:22:26.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.853+0000 7f5c80a00640 1 -- start start 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.853+0000 7f5c80a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5c7c06e450 0x7f5c7c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c80a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c7c14dac0 0x7f5c7c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c80a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c7c06e830 con 0x7f5c7c13ef30 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c80a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7c0b0d10 con 0x7f5c7c14dac0 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c80a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7c0b0a30 con 0x7f5c7c06e450 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c73e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5c7c13ef30 0x7f5c7c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36256/0 (socket says 172.21.15.16:36256) 2024-04-26T22:22:26.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c73e00640 1 -- 172.21.15.16:0/4104407070 learned_addr learned my addr 172.21.15.16:0/4104407070 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 --2- 172.21.15.16:0/4104407070 >> v2:172.21.15.16:3300/0 conn(0x7f5c7c14dac0 0x7f5c7c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c79e00640 1 --2- 172.21.15.16:0/4104407070 >> v2:172.21.15.195:3300/0 conn(0x7f5c7c06e450 0x7f5c7c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c79400640 1 -- 172.21.15.16:0/4104407070 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596400035 0 0) 0x7f5c7c06e830 con 0x7f5c7c13ef30 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c79400640 1 -- 172.21.15.16:0/4104407070 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c60003530 con 0x7f5c7c13ef30 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 -- 172.21.15.16:0/4104407070 >> v2:172.21.15.195:3300/0 conn(0x7f5c7c06e450 msgr2=0x7f5c7c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 --2- 172.21.15.16:0/4104407070 >> v2:172.21.15.195:3300/0 conn(0x7f5c7c06e450 0x7f5c7c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 -- 172.21.15.16:0/4104407070 >> v1:172.21.15.16:6789/0 conn(0x7f5c7c13ef30 legacy=0x7f5c7c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 -- 172.21.15.16:0/4104407070 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c0b2cf0 con 0x7f5c7c14dac0 2024-04-26T22:22:26.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c7a800640 1 --2- 172.21.15.16:0/4104407070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c14feb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0b0e90 tx=0x7f5c7401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8f60a993eb0b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c79400640 1 -- 172.21.15.16:0/4104407070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c740b2070 con 0x7f5c7c14dac0 2024-04-26T22:22:26.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.857+0000 7f5c79400640 1 -- 172.21.15.16:0/4104407070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c740a57c0 con 0x7f5c7c14dac0 2024-04-26T22:22:26.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79400640 1 -- 172.21.15.16:0/4104407070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c740a5b90 con 0x7f5c7c14dac0 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- 172.21.15.16:0/4104407070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c14dac0 msgr2=0x7f5c7c14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- 172.21.15.16:0/4104407070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c14feb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0b0e90 tx=0x7f5c7401c810 comp rx=0 tx=0).stop 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- 172.21.15.16:0/4104407070 shutdown_connections 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- 172.21.15.16:0/4104407070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c14feb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- 172.21.15.16:0/4104407070 >> v2:172.21.15.195:3300/0 conn(0x7f5c7c06e450 0x7f5c7c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- 172.21.15.16:0/4104407070 >> 172.21.15.16:0/4104407070 conn(0x7f5c7c0b6620 msgr2=0x7f5c7c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:26.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- 172.21.15.16:0/4104407070 shutdown_connections 2024-04-26T22:22:26.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- 172.21.15.16:0/4104407070 wait complete. 2024-04-26T22:22:26.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 Processor -- start 2024-04-26T22:22:26.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- start start 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c7c13ef30 0x7f5c7c1e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c1e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c0b63e0 con 0x7f5c7c06e450 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c0b6260 con 0x7f5c7c14dac0 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c80a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7c0b2830 con 0x7f5c7c13ef30 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41308/0 (socket says 172.21.15.16:41308) 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 -- 172.21.15.16:0/2749007425 learned_addr learned my addr 172.21.15.16:0/2749007425 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c7a800640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c1e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c73e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c7c13ef30 0x7f5c7c1e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 -- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c7c13ef30 msgr2=0x7f5c7c1e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c7c13ef30 0x7f5c7c1e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 -- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 msgr2=0x7f5c7c1e23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c1e23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c79e00640 1 -- 172.21.15.16:0/2749007425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c140f60 con 0x7f5c7c06e450 2024-04-26T22:22:26.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.861+0000 7f5c7a800640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c1e23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:26.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c79e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d800 tx=0x7f5c6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00b6c0 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6c019070 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00bae0 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7c145f30 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7c0737e0 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7c073b80 con 0x7f5c7c06e450 2024-04-26T22:22:26.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c6c00bc80 con 0x7f5c7c06e450 2024-04-26T22:22:26.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 0x7f5c5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:26.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.865+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f5c6c086bc0 con 0x7f5c7c06e450 2024-04-26T22:22:26.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.869+0000 7f5c73e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 0x7f5c5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:26.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.869+0000 7f5c73e00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 0x7f5c5806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c144fb0 tx=0x7f5c64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:26.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:26.869+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c7c140f60 con 0x7f5c7c06e450 2024-04-26T22:22:27.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.033+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c7c069530 con 0x7f5c58068380 2024-04-26T22:22:27.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.033+0000 7f5c72000640 1 -- 172.21.15.16:0/2749007425 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13470 (secure 0 0 0) 0x7f5c7c069530 con 0x7f5c58068380 2024-04-26T22:22:27.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:27.041 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:27.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 msgr2=0x7f5c5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 0x7f5c5806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c144fb0 tx=0x7f5c64009040 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 msgr2=0x7f5c7c145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00d800 tx=0x7f5c6c00dcc0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 shutdown_connections 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5c58068380 0x7f5c5806a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5c7c14dac0 0x7f5c7c1e23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5c7c13ef30 0x7f5c7c1e1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 --2- 172.21.15.16:0/2749007425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c7c06e450 0x7f5c7c145240 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 >> 172.21.15.16:0/2749007425 conn(0x7f5c7c0b6620 msgr2=0x7f5c7c0b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:27.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 shutdown_connections 2024-04-26T22:22:27.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.037+0000 7f5c80a00640 1 -- 172.21.15.16:0/2749007425 wait complete. 2024-04-26T22:22:27.062 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T22:22:26.115698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253444,"kb_used_data":4000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721276,"statfs":{"total":773094113280,"available":772834586624,"internally_reserved":0,"allocated":4096000,"data_stored":2291449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10891,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T22:22:22.111037+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:22.111037+0000","last_peered":"2024-04-26T22:22:22.111037+0000","last_clean":"2024-04-26T22:22:22.111037+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:22.111037+0000","last_undegraded":"2024-04-26T22:22:22.111037+0000","last_fullsized":"2024-04-26T22:22:22.111037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":135547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":356352,"data_stored":135513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":725811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:27.062 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T22:22:27.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:27.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 Processor -- start 2024-04-26T22:22:27.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 -- start start 2024-04-26T22:22:27.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd6e40a0bb0 0x7fd6e40708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 0x7fd6e4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e40700f0 con 0x7fd6e40a07d0 2024-04-26T22:22:27.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e4070420 con 0x7fd6e40a0bb0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e4149330 con 0x7fd6e41489c0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e2a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd6e40a07d0 0x7fd6e4073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36266/0 (socket says 172.21.15.16:36266) 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e2a00640 1 -- 172.21.15.16:0/323233692 learned_addr learned my addr 172.21.15.16:0/323233692 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.197+0000 7fd6e3400640 1 --2- 172.21.15.16:0/323233692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 0x7fd6e4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6dbe00640 1 --2- 172.21.15.16:0/323233692 >> v2:172.21.15.195:3300/0 conn(0x7fd6e40a0bb0 0x7fd6e40708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e2000640 1 -- 172.21.15.16:0/323233692 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308762307 0 0) 0x7fd6e40700f0 con 0x7fd6e40a07d0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e2000640 1 -- 172.21.15.16:0/323233692 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c8003530 con 0x7fd6e40a07d0 2024-04-26T22:22:27.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e3400640 1 -- 172.21.15.16:0/323233692 >> v2:172.21.15.195:3300/0 conn(0x7fd6e40a0bb0 msgr2=0x7fd6e40708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:27.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e3400640 1 --2- 172.21.15.16:0/323233692 >> v2:172.21.15.195:3300/0 conn(0x7fd6e40a0bb0 0x7fd6e40708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e3400640 1 -- 172.21.15.16:0/323233692 >> v1:172.21.15.16:6789/0 conn(0x7fd6e40a07d0 legacy=0x7fd6e4073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e3400640 1 -- 172.21.15.16:0/323233692 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e4071140 con 0x7fd6e41489c0 2024-04-26T22:22:27.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e3400640 1 --2- 172.21.15.16:0/323233692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 0x7fd6e4152e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009d90 tx=0x7fd6dc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb965fea0cc1b9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e2000640 1 -- 172.21.15.16:0/323233692 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0b2070 con 0x7fd6e41489c0 2024-04-26T22:22:27.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e2000640 1 -- 172.21.15.16:0/323233692 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0a59c0 con 0x7fd6e41489c0 2024-04-26T22:22:27.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.201+0000 7fd6e2000640 1 -- 172.21.15.16:0/323233692 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0a5d90 con 0x7fd6e41489c0 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- 172.21.15.16:0/323233692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 msgr2=0x7fd6e4152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/323233692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 0x7fd6e4152e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009d90 tx=0x7fd6dc01c8e0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- 172.21.15.16:0/323233692 shutdown_connections 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/323233692 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e41489c0 0x7fd6e4152e20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/323233692 >> v2:172.21.15.195:3300/0 conn(0x7fd6e40a0bb0 0x7fd6e40708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- 172.21.15.16:0/323233692 >> 172.21.15.16:0/323233692 conn(0x7fd6e40b87c0 msgr2=0x7fd6e40b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:27.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- 172.21.15.16:0/323233692 shutdown_connections 2024-04-26T22:22:27.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- 172.21.15.16:0/323233692 wait complete. 2024-04-26T22:22:27.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 Processor -- start 2024-04-26T22:22:27.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- start start 2024-04-26T22:22:27.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e40a07d0 0x7fd6e413a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 0x7fd6e4140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4155b80 con 0x7fd6e41489c0 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e41490c0 con 0x7fd6e40a0bb0 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e9e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e4155d00 con 0x7fd6e40a07d0 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41314/0 (socket says 172.21.15.16:41314) 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 -- 172.21.15.16:0/3551659428 learned_addr learned my addr 172.21.15.16:0/3551659428 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:27.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e2a00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e40a07d0 0x7fd6e413a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6dbe00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 0x7fd6e4140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 -- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e40a07d0 msgr2=0x7fd6e413a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e40a07d0 0x7fd6e413a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 -- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 msgr2=0x7fd6e4140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 0x7fd6e4140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 -- 172.21.15.16:0/3551659428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e413bcb0 con 0x7fd6e41489c0 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6dbe00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 0x7fd6e4140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:27.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6e3400640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0b0040 tx=0x7fd6dc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.205+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0b2050 con 0x7fd6e41489c0 2024-04-26T22:22:27.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0be070 con 0x7fd6e41489c0 2024-04-26T22:22:27.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0ada90 con 0x7fd6e41489c0 2024-04-26T22:22:27.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e413cc00 con 0x7fd6e41489c0 2024-04-26T22:22:27.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e4142280 con 0x7fd6e41489c0 2024-04-26T22:22:27.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e4069530 con 0x7fd6e41489c0 2024-04-26T22:22:27.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6dc0adc30 con 0x7fd6e41489c0 2024-04-26T22:22:27.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6db400640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 0x7fd6c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fd6dc1216e0 con 0x7fd6e41489c0 2024-04-26T22:22:27.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.209+0000 7fd6e2a00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 0x7fd6c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.213+0000 7fd6e2a00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 0x7fd6c006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005890 tx=0x7fd6d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.217+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6dc016560 con 0x7fd6e41489c0 2024-04-26T22:22:27.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6e40b6070 con 0x7fd6c0068380 2024-04-26T22:22:27.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6db400640 1 -- 172.21.15.16:0/3551659428 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13470 (secure 0 0 0) 0x7fd6e40b6070 con 0x7fd6c0068380 2024-04-26T22:22:27.383 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:27.383 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 msgr2=0x7fd6c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 0x7fd6c006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005890 tx=0x7fd6d4009040 comp rx=0 tx=0).stop 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 msgr2=0x7fd6e413b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0b0040 tx=0x7fd6dc019680 comp rx=0 tx=0).stop 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 shutdown_connections 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd6c0068380 0x7fd6c006a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6e41489c0 0x7fd6e413b510 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6e40a0bb0 0x7fd6e4140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 --2- 172.21.15.16:0/3551659428 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6e40a07d0 0x7fd6e413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 >> 172.21.15.16:0/3551659428 conn(0x7fd6e40b87c0 msgr2=0x7fd6e40baab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 shutdown_connections 2024-04-26T22:22:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.377+0000 7fd6e9e00640 1 -- 172.21.15.16:0/3551659428 wait complete. 2024-04-26T22:22:27.404 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T22:22:26.115698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253444,"kb_used_data":4000,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721276,"statfs":{"total":773094113280,"available":772834586624,"internally_reserved":0,"allocated":4096000,"data_stored":2291449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10891,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-54,"num_write_kb":-26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T22:22:22.111037+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:22.111037+0000","last_peered":"2024-04-26T22:22:22.111037+0000","last_clean":"2024-04-26T22:22:22.111037+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:22.111037+0000","last_undegraded":"2024-04-26T22:22:22.111037+0000","last_fullsized":"2024-04-26T22:22:22.111037+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":950272,"data_stored":725901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":136115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":360448,"data_stored":135547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":356352,"data_stored":135513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":145558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":725811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:27.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:22:27.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.537+0000 7f4d72400640 1 Processor -- start 2024-04-26T22:22:27.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d72400640 1 -- start start 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d72400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d6c0b88e0 0x7f4d6c0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d72400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c0b8cc0 con 0x7f4d6c146240 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d72400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c0b6c10 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d72400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c0b6ef0 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d71000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d6c0b88e0 0x7f4d6c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d6be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4d6c146240 0x7f4d6c0b7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36272/0 (socket says 172.21.15.16:36272) 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d6be00640 1 -- 172.21.15.16:0/3048287429 learned_addr learned my addr 172.21.15.16:0/3048287429 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d71000640 1 -- 172.21.15.16:0/3048287429 >> v1:172.21.15.195:6789/0 conn(0x7f4d6c0b53b0 legacy=0x7f4d6c150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:27.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d71000640 1 -- 172.21.15.16:0/3048287429 >> v1:172.21.15.16:6789/0 conn(0x7f4d6c146240 legacy=0x7f4d6c0b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d6b400640 1 -- 172.21.15.16:0/3048287429 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242498899 0 0) 0x7f4d6c0b8cc0 con 0x7f4d6c146240 2024-04-26T22:22:27.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.541+0000 7f4d71000640 1 -- 172.21.15.16:0/3048287429 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0b5fd0 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d71000640 1 --2- 172.21.15.16:0/3048287429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b88e0 0x7f4d6c0b65f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097c0 tx=0x7f4d6001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3e5feb811fa655 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d6b400640 1 -- 172.21.15.16:0/3048287429 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d600b0070 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d6b400640 1 -- 172.21.15.16:0/3048287429 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d600ab600 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d6b400640 1 -- 172.21.15.16:0/3048287429 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d600ab9d0 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- 172.21.15.16:0/3048287429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b88e0 msgr2=0x7f4d6c0b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 --2- 172.21.15.16:0/3048287429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b88e0 0x7f4d6c0b65f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d600097c0 tx=0x7f4d6001c340 comp rx=0 tx=0).stop 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- 172.21.15.16:0/3048287429 shutdown_connections 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 --2- 172.21.15.16:0/3048287429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b88e0 0x7f4d6c0b65f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- 172.21.15.16:0/3048287429 >> 172.21.15.16:0/3048287429 conn(0x7f4d6c06f500 msgr2=0x7f4d6c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- 172.21.15.16:0/3048287429 shutdown_connections 2024-04-26T22:22:27.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- 172.21.15.16:0/3048287429 wait complete. 2024-04-26T22:22:27.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 Processor -- start 2024-04-26T22:22:27.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- start start 2024-04-26T22:22:27.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c0b88e0 0x7f4d6c141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 0x7f4d6c1df800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b5c10 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b8010 con 0x7f4d6c1df370 2024-04-26T22:22:27.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d72400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c073ee0 con 0x7f4d6c0b88e0 2024-04-26T22:22:27.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.545+0000 7f4d71000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41334/0 (socket says 172.21.15.16:41334) 2024-04-26T22:22:27.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 -- 172.21.15.16:0/2956142777 learned_addr learned my addr 172.21.15.16:0/2956142777 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:27.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d6be00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c0b88e0 0x7f4d6c141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 -- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c0b88e0 msgr2=0x7f4d6c141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71a00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 0x7f4d6c1df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c0b88e0 0x7f4d6c141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 -- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 msgr2=0x7f4d6c1df800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 0x7f4d6c1df800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 -- 172.21.15.16:0/2956142777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c13ddd0 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71a00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 0x7f4d6c1df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d71000640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ae040 tx=0x7f4d6001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d600b0040 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60004230 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60003620 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c1431b0 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c143490 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c1dec80 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.549+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d600037c0 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.553+0000 7f4d68c00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 0x7f4d4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:27.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.553+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f4d60121500 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.553+0000 7f4d6be00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 0x7f4d4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:27.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.553+0000 7f4d6be00640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 0x7f4d4c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06fac0 tx=0x7f4d58007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:27.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.557+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4d60016050 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.725+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d6c0507b0 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.725+0000 7f4d68c00640 1 -- 172.21.15.16:0/2956142777 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13008 (secure 0 0 0) 0x7f4d600f1ed0 con 0x7f4d6c0b53b0 2024-04-26T22:22:27.732 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:27.732 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"fsid":"53f352df-dd5a-41be-a68c-8728a38a6452","created":"2024-04-26T22:20:57.089883+0000","modified":"2024-04-26T22:22:24.608340+0000","last_up_change":"2024-04-26T22:21:08.618730+0000","last_in_change":"2024-04-26T22:20:59.582829+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T22:21:10.129112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d43f67-b986-46ba-a39a-d5de48a35630","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6801","nonce":3251041716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6803","nonce":3251041716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6807","nonce":3251041716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":3251041716},{"type":"v1","addr":"172.21.15.16:6805","nonce":3251041716}]},"public_addr":"172.21.15.16:6801/3251041716","cluster_addr":"172.21.15.16:6803/3251041716","heartbeat_back_addr":"172.21.15.16:6807/3251041716","heartbeat_front_addr":"172.21.15.16:6805/3251041716","state":["exists","up"]},{"osd":1,"uuid":"e545e72a-7bbd-4d7a-823d-ca6d904bf2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6809","nonce":4148881658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6811","nonce":4148881658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6815","nonce":4148881658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4148881658},{"type":"v1","addr":"172.21.15.16:6813","nonce":4148881658}]},"public_addr":"172.21.15.16:6809/4148881658","cluster_addr":"172.21.15.16:6811/4148881658","heartbeat_back_addr":"172.21.15.16:6815/4148881658","heartbeat_front_addr":"172.21.15.16:6813/4148881658","state":["exists","up"]},{"osd":2,"uuid":"a0827846-c13e-4061-a4a0-eb1914fef91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6817","nonce":3412985029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6819","nonce":3412985029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6823","nonce":3412985029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3412985029},{"type":"v1","addr":"172.21.15.16:6821","nonce":3412985029}]},"public_addr":"172.21.15.16:6817/3412985029","cluster_addr":"172.21.15.16:6819/3412985029","heartbeat_back_addr":"172.21.15.16:6823/3412985029","heartbeat_front_addr":"172.21.15.16:6821/3412985029","state":["exists","up"]},{"osd":3,"uuid":"c377631a-cda7-4b08-9179-86d40cb93428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6825","nonce":700828209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6827","nonce":700828209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6831","nonce":700828209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":700828209},{"type":"v1","addr":"172.21.15.16:6829","nonce":700828209}]},"public_addr":"172.21.15.16:6825/700828209","cluster_addr":"172.21.15.16:6827/700828209","heartbeat_back_addr":"172.21.15.16:6831/700828209","heartbeat_front_addr":"172.21.15.16:6829/700828209","state":["exists","up"]},{"osd":4,"uuid":"d8e73c75-8066-4d99-8060-21b18ecaedec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6818","nonce":2204977921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6822","nonce":2204977921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6830","nonce":2204977921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2204977921},{"type":"v1","addr":"172.21.15.195:6826","nonce":2204977921}]},"public_addr":"172.21.15.195:6818/2204977921","cluster_addr":"172.21.15.195:6822/2204977921","heartbeat_back_addr":"172.21.15.195:6830/2204977921","heartbeat_front_addr":"172.21.15.195:6826/2204977921","state":["exists","up"]},{"osd":5,"uuid":"255b3049-89ef-4e24-961c-02ccf8d4aae7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6801","nonce":228290065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6803","nonce":228290065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6807","nonce":228290065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":228290065},{"type":"v1","addr":"172.21.15.195:6805","nonce":228290065}]},"public_addr":"172.21.15.195:6801/228290065","cluster_addr":"172.21.15.195:6803/228290065","heartbeat_back_addr":"172.21.15.195:6807/228290065","heartbeat_front_addr":"172.21.15.195:6805/228290065","state":["exists","up"]},{"osd":6,"uuid":"eb0d07ed-f619-4c0f-bc0f-9a8ecfcf6ddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6817","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6819","nonce":3327636089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6821","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6823","nonce":3327636089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6829","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6831","nonce":3327636089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6825","nonce":3327636089},{"type":"v1","addr":"172.21.15.195:6827","nonce":3327636089}]},"public_addr":"172.21.15.195:6819/3327636089","cluster_addr":"172.21.15.195:6823/3327636089","heartbeat_back_addr":"172.21.15.195:6831/3327636089","heartbeat_front_addr":"172.21.15.195:6827/3327636089","state":["exists","up"]},{"osd":7,"uuid":"5da046ca-0dc8-4408-9b92-7cddb2f94d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6809","nonce":4215805328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6811","nonce":4215805328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6815","nonce":4215805328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":4215805328},{"type":"v1","addr":"172.21.15.195:6813","nonce":4215805328}]},"public_addr":"172.21.15.195:6809/4215805328","cluster_addr":"172.21.15.195:6811/4215805328","heartbeat_back_addr":"172.21.15.195:6815/4215805328","heartbeat_front_addr":"172.21.15.195:6813/4215805328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.095126+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.235775+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.330744+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.354451+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.401431+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.286467+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.420078+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T22:21:05.210694+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6833/3696570789":"2024-04-27T22:22:21.598309+0000","172.21.15.16:6832/3696570789":"2024-04-27T22:22:21.598309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 msgr2=0x7f4d4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 0x7f4d4c06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06fac0 tx=0x7f4d58007b60 comp rx=0 tx=0).stop 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 msgr2=0x7f4d6c142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ae040 tx=0x7f4d6001ab80 comp rx=0 tx=0).stop 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 shutdown_connections 2024-04-26T22:22:27.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f4d4c068380 0x7f4d4c06a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d6c1df370 0x7f4d6c1df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4d6c0b88e0 0x7f4d6c141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 --2- 172.21.15.16:0/2956142777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d6c0b53b0 0x7f4d6c142960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 >> 172.21.15.16:0/2956142777 conn(0x7f4d6c06f500 msgr2=0x7f4d6c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 shutdown_connections 2024-04-26T22:22:27.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:27.729+0000 7f4d72400640 1 -- 172.21.15.16:0/2956142777 wait complete. 2024-04-26T22:22:28.753 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T22:22:28.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 Processor -- start 2024-04-26T22:22:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 -- start start 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 0x7eff5813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff581450f0 0x7eff58145520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5806e140 con 0x7eff580b62e0 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7eff5813f3a0 con 0x7eff581450f0 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff5dc00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7eff58144bf0 con 0x7eff5813ea00 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff581450f0 0x7eff58145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff581450f0 0x7eff58145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41348/0 (socket says 172.21.15.16:41348) 2024-04-26T22:22:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 -- 172.21.15.16:0/356441923 learned_addr learned my addr 172.21.15.16:0/356441923 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff56000640 1 --2- 172.21.15.16:0/356441923 >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 0x7eff5813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 -- 172.21.15.16:0/356441923 >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 msgr2=0x7eff5813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 --2- 172.21.15.16:0/356441923 >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 0x7eff5813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 -- 172.21.15.16:0/356441923 >> v1:172.21.15.195:6789/0 conn(0x7eff580b62e0 legacy=0x7eff5806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff57400640 1 -- 172.21.15.16:0/356441923 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff58145a60 con 0x7eff581450f0 2024-04-26T22:22:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.905+0000 7eff56000640 1 --2- 172.21.15.16:0/356441923 >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 0x7eff5813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:28.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff57400640 1 --2- 172.21.15.16:0/356441923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff58145520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7eff580b4a10 tx=0x7eff5001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e7743eb19b916 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff55600640 1 -- 172.21.15.16:0/356441923 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500a5770 con 0x7eff581450f0 2024-04-26T22:22:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff55600640 1 -- 172.21.15.16:0/356441923 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff500a5910 con 0x7eff581450f0 2024-04-26T22:22:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff55600640 1 -- 172.21.15.16:0/356441923 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500a5ce0 con 0x7eff581450f0 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 -- 172.21.15.16:0/356441923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 msgr2=0x7eff58145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 --2- 172.21.15.16:0/356441923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff58145520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7eff580b4a10 tx=0x7eff5001c930 comp rx=0 tx=0).stop 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 -- 172.21.15.16:0/356441923 shutdown_connections 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 --2- 172.21.15.16:0/356441923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff58145520 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 --2- 172.21.15.16:0/356441923 >> v2:172.21.15.195:3300/0 conn(0x7eff5813ea00 0x7eff5813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 -- 172.21.15.16:0/356441923 >> 172.21.15.16:0/356441923 conn(0x7eff5809c100 msgr2=0x7eff5809c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 -- 172.21.15.16:0/356441923 shutdown_connections 2024-04-26T22:22:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.909+0000 7eff5dc00640 1 -- 172.21.15.16:0/356441923 wait complete. 2024-04-26T22:22:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 Processor -- start 2024-04-26T22:22:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- start start 2024-04-26T22:22:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580b62e0 0x7eff580b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5813ea00 0x7eff580b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff580b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff580b6840 con 0x7eff581450f0 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7eff580b66c0 con 0x7eff580b62e0 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7eff5814f490 con 0x7eff5813ea00 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff580b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff580b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41362/0 (socket says 172.21.15.16:41362) 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 -- 172.21.15.16:0/1108485977 learned_addr learned my addr 172.21.15.16:0/1108485977 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff56a00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580b62e0 0x7eff580b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff56000640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5813ea00 0x7eff580b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 -- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5813ea00 msgr2=0x7eff580b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5813ea00 0x7eff580b96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 -- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580b62e0 msgr2=0x7eff580b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580b62e0 0x7eff580b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff580b3040 con 0x7eff581450f0 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff56000640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7eff5813ea00 0x7eff580b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff57400640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff580b3940 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7eff50019540 tx=0x7eff500196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500bc020 con 0x7eff581450f0 2024-04-26T22:22:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff500b8670 con 0x7eff581450f0 2024-04-26T22:22:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff500b8a40 con 0x7eff581450f0 2024-04-26T22:22:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff581df280 con 0x7eff581450f0 2024-04-26T22:22:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff580b2d60 con 0x7eff581450f0 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.913+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff58069530 con 0x7eff581450f0 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff500bf020 con 0x7eff581450f0 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7eff380683b0 0x7eff3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7eff50121750 con 0x7eff581450f0 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7eff3806e270 0x7eff38070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff500b0ec0 con 0x7eff3806e270 2024-04-26T22:22:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7eff50128050 con 0x7eff581450f0 2024-04-26T22:22:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff56a00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7eff380683b0 0x7eff3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff56000640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7eff3806e270 0x7eff38070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff56a00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7eff380683b0 0x7eff3806a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff58150990 tx=0x7eff48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff56000640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7eff3806e270 0x7eff38070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.917+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== osd.0 v2:172.21.15.16:6800/3251041716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff500b0ec0 con 0x7eff3806e270 2024-04-26T22:22:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 --> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff580741d0 con 0x7eff3806e270 2024-04-26T22:22:28.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff4ea00640 1 -- 172.21.15.16:0/1108485977 <== osd.0 v2:172.21.15.16:6800/3251041716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff580741d0 con 0x7eff3806e270 2024-04-26T22:22:28.938 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:28.938 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:28.938 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7eff3806e270 msgr2=0x7eff38070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:6800/3251041716,v1:172.21.15.16:6801/3251041716] conn(0x7eff3806e270 0x7eff38070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7eff380683b0 msgr2=0x7eff3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7eff380683b0 0x7eff3806a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff58150990 tx=0x7eff48009040 comp rx=0 tx=0).stop 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 msgr2=0x7eff580b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 --2- 172.21.15.16:0/1108485977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff581450f0 0x7eff580b3940 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7eff50019540 tx=0x7eff500196d0 comp rx=0 tx=0).stop 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff57400640 1 -- 172.21.15.16:0/1108485977 reap_dead start 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 shutdown_connections 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 >> 172.21.15.16:0/1108485977 conn(0x7eff5809c100 msgr2=0x7eff58073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 shutdown_connections 2024-04-26T22:22:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:28.933+0000 7eff5dc00640 1 -- 172.21.15.16:0/1108485977 wait complete. 2024-04-26T22:22:28.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T22:22:29.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 Processor -- start 2024-04-26T22:22:29.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 -- start start 2024-04-26T22:22:29.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b4146270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b40718f0 con 0x7f55b414a0c0 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b41467b0 con 0x7f55b40b3710 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55baa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f55b4070a00 con 0x7f55b4070620 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b8a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f55b414a0c0 0x7f55b413fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36286/0 (socket says 172.21.15.16:36286) 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b8a00640 1 -- 172.21.15.16:0/2731684983 learned_addr learned my addr 172.21.15.16:0/2731684983 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3e00640 1 --2- 172.21.15.16:0/2731684983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b4146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985705555 0 0) 0x7f55b40718f0 con 0x7f55b414a0c0 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5598003530 con 0x7f55b414a0c0 2024-04-26T22:22:29.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3e00640 1 -- 172.21.15.16:0/2731684983 >> v1:172.21.15.195:6789/0 conn(0x7f55b40b3710 legacy=0x7f55b41499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073010419 0 0) 0x7f55b41467b0 con 0x7f55b40b3710 2024-04-26T22:22:29.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3e00640 1 -- 172.21.15.16:0/2731684983 >> v1:172.21.15.16:6789/0 conn(0x7f55b414a0c0 legacy=0x7f55b413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.093+0000 7f55b3e00640 1 -- 172.21.15.16:0/2731684983 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b4146a40 con 0x7f55b4070620 2024-04-26T22:22:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55b3e00640 1 --2- 172.21.15.16:0/2731684983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b4146270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009dc0 tx=0x7f55a401c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c597a9e5b9ee8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40b2070 con 0x7f55b4070620 2024-04-26T22:22:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a40a5990 con 0x7f55b4070620 2024-04-26T22:22:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55b3400640 1 -- 172.21.15.16:0/2731684983 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40a5d40 con 0x7f55b4070620 2024-04-26T22:22:29.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 -- 172.21.15.16:0/2731684983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 msgr2=0x7f55b4146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 --2- 172.21.15.16:0/2731684983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b4146270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009dc0 tx=0x7f55a401c8d0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 -- 172.21.15.16:0/2731684983 shutdown_connections 2024-04-26T22:22:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 --2- 172.21.15.16:0/2731684983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b4146270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 -- 172.21.15.16:0/2731684983 >> 172.21.15.16:0/2731684983 conn(0x7f55b40b6620 msgr2=0x7f55b40b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 -- 172.21.15.16:0/2731684983 shutdown_connections 2024-04-26T22:22:29.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.097+0000 7f55baa00640 1 -- 172.21.15.16:0/2731684983 wait complete. 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 Processor -- start 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- start start 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b40afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55b414a0c0 0x7f55b41e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55b4154b60 con 0x7f55b40b2cf0 2024-04-26T22:22:29.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f55b41549e0 con 0x7f55b414a0c0 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f55b4154ce0 con 0x7f55b4070620 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41368/0 (socket says 172.21.15.16:41368) 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 -- 172.21.15.16:0/2537073550 learned_addr learned my addr 172.21.15.16:0/2537073550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b3e00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b40afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55ab400640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55b414a0c0 0x7f55b41e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 -- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 msgr2=0x7f55b40afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b40afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 -- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55b414a0c0 msgr2=0x7f55b41e1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55b414a0c0 0x7f55b41e1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 -- 172.21.15.16:0/2537073550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b41429d0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b8a00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c3c0 tx=0x7f55ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac017070 con 0x7f55b40b2cf0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ac005cf0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0072d0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b40b24f0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b40b0680 con 0x7f55b40b2cf0 2024-04-26T22:22:29.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.101+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55b4069450 con 0x7f55b40b2cf0 2024-04-26T22:22:29.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.105+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55ac01a070 con 0x7f55b40b2cf0 2024-04-26T22:22:29.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.105+0000 7f55b0c00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 0x7f559006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.105+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f55ac0858c0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.105+0000 7f55b3e00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 0x7f559006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.105+0000 7f55b3e00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 0x7f559006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55a40af000 tx=0x7f55a40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.109+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f55ac055be0 con 0x7f55b40b2cf0 2024-04-26T22:22:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.273+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f55b4151980 con 0x7f5590068380 2024-04-26T22:22:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.273+0000 7f55b0c00640 1 -- 172.21.15.16:0/2537073550 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55b4151980 con 0x7f5590068380 2024-04-26T22:22:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T22:22:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 msgr2=0x7f559006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 0x7f559006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55a40af000 tx=0x7f55a40a7070 comp rx=0 tx=0).stop 2024-04-26T22:22:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 msgr2=0x7f55b413e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00c3c0 tx=0x7f55ac00c880 comp rx=0 tx=0).stop 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 shutdown_connections 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f5590068380 0x7f559006a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55b40b2cf0 0x7f55b413e2d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f55b414a0c0 0x7f55b41e1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 --2- 172.21.15.16:0/2537073550 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f55b4070620 0x7f55b40afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 >> 172.21.15.16:0/2537073550 conn(0x7f55b40b6620 msgr2=0x7f55b40725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 shutdown_connections 2024-04-26T22:22:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.277+0000 7f55baa00640 1 -- 172.21.15.16:0/2537073550 wait complete. 2024-04-26T22:22:29.302 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T22:22:29.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:29.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 Processor -- start 2024-04-26T22:22:29.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 -- start start 2024-04-26T22:22:29.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 0x7fda0013f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fda000b3590 0x7fda0014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000b5c70 con 0x7fda000b22f0 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fda000b19d0 con 0x7fda000b3590 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda07200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda000b1cb0 con 0x7fda000b5890 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda05200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fda000b3590 0x7fda0014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fd9f7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fda000b22f0 0x7fda001489a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36304/0 (socket says 172.21.15.16:36304) 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fd9f7e00640 1 -- 172.21.15.16:0/3904688921 learned_addr learned my addr 172.21.15.16:0/3904688921 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.441+0000 7fda05200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fda000b3590 0x7fda0014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41384/0 (socket says 172.21.15.16:41384) 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ffe00640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 0x7fda0013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda05200640 1 -- 172.21.15.16:0/3904688921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 msgr2=0x7fda0013f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda05200640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 0x7fda0013f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda05200640 1 -- 172.21.15.16:0/3904688921 >> v1:172.21.15.16:6789/0 conn(0x7fda000b22f0 legacy=0x7fda001489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda05200640 1 -- 172.21.15.16:0/3904688921 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda000b1f90 con 0x7fda000b3590 2024-04-26T22:22:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ff400640 1 -- 172.21.15.16:0/3904688921 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099186720 0 0) 0x7fda000b5c70 con 0x7fda000b22f0 2024-04-26T22:22:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ffe00640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 0x7fda0013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda05200640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b3590 0x7fda0014fa90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c71e1867f53e69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ff400640 1 -- 172.21.15.16:0/3904688921 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80b4070 con 0x7fda000b3590 2024-04-26T22:22:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ff400640 1 -- 172.21.15.16:0/3904688921 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f80af600 con 0x7fda000b3590 2024-04-26T22:22:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fd9ff400640 1 -- 172.21.15.16:0/3904688921 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80af9d0 con 0x7fda000b3590 2024-04-26T22:22:29.453 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.445+0000 7fda07200640 1 -- 172.21.15.16:0/3904688921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b3590 msgr2=0x7fda0014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b3590 0x7fda0014fa90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009d90 tx=0x7fd9f801f150 comp rx=0 tx=0).stop 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/3904688921 shutdown_connections 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b3590 0x7fda0014fa90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- 172.21.15.16:0/3904688921 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b5890 0x7fda0013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/3904688921 >> 172.21.15.16:0/3904688921 conn(0x7fda000b6620 msgr2=0x7fda000b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/3904688921 shutdown_connections 2024-04-26T22:22:29.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/3904688921 wait complete. 2024-04-26T22:22:29.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 Processor -- start 2024-04-26T22:22:29.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- start start 2024-04-26T22:22:29.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 0x7fda0013e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b3590 0x7fda00147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda000b5890 0x7fda00140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda00149230 con 0x7fda000b22f0 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fda001490b0 con 0x7fda000b5890 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fda00148300 con 0x7fda000b3590 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 0x7fda0013e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 0x7fda0013e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41386/0 (socket says 172.21.15.16:41386) 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 -- 172.21.15.16:0/2531322870 learned_addr learned my addr 172.21.15.16:0/2531322870 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9f7e00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b3590 0x7fda00147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 -- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b3590 msgr2=0x7fda00147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda05200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda000b5890 0x7fda00140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b3590 0x7fda00147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 -- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda000b5890 msgr2=0x7fda00140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda000b5890 0x7fda00140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda001416c0 con 0x7fda000b22f0 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda05200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda000b5890 0x7fda00140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9f7e00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fda000b3590 0x7fda00147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9ffe00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 0x7fda0013e270 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c7f0 tx=0x7fd9f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0015070 con 0x7fda000b22f0 2024-04-26T22:22:29.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0007820 con 0x7fda000b22f0 2024-04-26T22:22:29.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0007c10 con 0x7fda000b22f0 2024-04-26T22:22:29.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda001400a0 con 0x7fda000b22f0 2024-04-26T22:22:29.460 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.449+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda00141160 con 0x7fda000b22f0 2024-04-26T22:22:29.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda0013f9d0 con 0x7fda000b22f0 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9f0018070 con 0x7fda000b22f0 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd9dc068380 0x7fd9dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fd9f0086800 con 0x7fda000b22f0 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fd9dc06e240 0x7fd9dc070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9f0004480 con 0x7fd9dc06e240 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9f008b2c0 con 0x7fda000b22f0 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9f7e00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd9dc068380 0x7fd9dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fda05200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fd9dc06e240 0x7fd9dc070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fd9f7e00640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd9dc068380 0x7fd9dc06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda000b5100 tx=0x7fd9e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.453+0000 7fda05200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fd9dc06e240 0x7fd9dc070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.457+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== osd.1 v2:172.21.15.16:6808/4148881658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9f0004480 con 0x7fd9dc06e240 2024-04-26T22:22:29.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 --> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda001423f0 con 0x7fd9dc06e240 2024-04-26T22:22:29.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fd9fcc00640 1 -- 172.21.15.16:0/2531322870 <== osd.1 v2:172.21.15.16:6808/4148881658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda001423f0 con 0x7fd9dc06e240 2024-04-26T22:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:29.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fd9dc06e240 msgr2=0x7fd9dc070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:6808/4148881658,v1:172.21.15.16:6809/4148881658] conn(0x7fd9dc06e240 0x7fd9dc070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd9dc068380 msgr2=0x7fd9dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fd9dc068380 0x7fd9dc06a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda000b5100 tx=0x7fd9e8009040 comp rx=0 tx=0).stop 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 msgr2=0x7fda0013e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 --2- 172.21.15.16:0/2531322870 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda000b22f0 0x7fda0013e270 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000c7f0 tx=0x7fd9f000ccb0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda05200640 1 -- 172.21.15.16:0/2531322870 reap_dead start 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 shutdown_connections 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 >> 172.21.15.16:0/2531322870 conn(0x7fda000b6620 msgr2=0x7fda000ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 shutdown_connections 2024-04-26T22:22:29.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.469+0000 7fda07200640 1 -- 172.21.15.16:0/2531322870 wait complete. 2024-04-26T22:22:29.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T22:22:29.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.629+0000 7fe356600640 1 Processor -- start 2024-04-26T22:22:29.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.629+0000 7fe356600640 1 -- start start 2024-04-26T22:22:29.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe356600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 0x7fe3501499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe356600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3500718f0 con 0x7fe350149ef0 2024-04-26T22:22:29.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe356600640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe350070a00 con 0x7fe350070620 2024-04-26T22:22:29.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe356600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe35014a3a0 con 0x7fe3500b3710 2024-04-26T22:22:29.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe350149ef0 0x7fe35013fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36310/0 (socket says 172.21.15.16:36310) 2024-04-26T22:22:29.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34fe00640 1 -- 172.21.15.16:0/2420609174 learned_addr learned my addr 172.21.15.16:0/2420609174 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:29.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe346a00640 1 --2- 172.21.15.16:0/2420609174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 0x7fe3501499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486434166 0 0) 0x7fe3500718f0 con 0x7fe350149ef0 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe334003530 con 0x7fe350149ef0 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336160200 0 0) 0x7fe350070a00 con 0x7fe350070620 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3500718f0 con 0x7fe350070620 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe346a00640 1 -- 172.21.15.16:0/2420609174 >> v1:172.21.15.195:6789/0 conn(0x7fe350070620 legacy=0x7fe350146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe346a00640 1 -- 172.21.15.16:0/2420609174 >> v1:172.21.15.16:6789/0 conn(0x7fe350149ef0 legacy=0x7fe35013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.633+0000 7fe346a00640 1 -- 172.21.15.16:0/2420609174 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350146a40 con 0x7fe3500b3710 2024-04-26T22:22:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe346a00640 1 --2- 172.21.15.16:0/2420609174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 0x7fe3501499b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097f0 tx=0x7fe33801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c4dea244d571d35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380ab620 con 0x7fe3500b3710 2024-04-26T22:22:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3380b0070 con 0x7fe3500b3710 2024-04-26T22:22:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34ea00640 1 -- 172.21.15.16:0/2420609174 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380ab9e0 con 0x7fe3500b3710 2024-04-26T22:22:29.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- 172.21.15.16:0/2420609174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 msgr2=0x7fe3501499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 --2- 172.21.15.16:0/2420609174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 0x7fe3501499b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097f0 tx=0x7fe33801c420 comp rx=0 tx=0).stop 2024-04-26T22:22:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- 172.21.15.16:0/2420609174 shutdown_connections 2024-04-26T22:22:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 --2- 172.21.15.16:0/2420609174 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3500b3710 0x7fe3501499b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- 172.21.15.16:0/2420609174 >> 172.21.15.16:0/2420609174 conn(0x7fe3500b6620 msgr2=0x7fe3500b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- 172.21.15.16:0/2420609174 shutdown_connections 2024-04-26T22:22:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- 172.21.15.16:0/2420609174 wait complete. 2024-04-26T22:22:29.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 Processor -- start 2024-04-26T22:22:29.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- start start 2024-04-26T22:22:29.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe350070620 0x7fe3501411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe350149ef0 0x7fe3500b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe350154b60 con 0x7fe3501483e0 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe3501549e0 con 0x7fe350070620 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe356600640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe350154ce0 con 0x7fe350149ef0 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41390/0 (socket says 172.21.15.16:41390) 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34fe00640 1 -- 172.21.15.16:0/3257442152 learned_addr learned my addr 172.21.15.16:0/3257442152 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe346a00640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe350149ef0 0x7fe3500b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.637+0000 7fe34f400640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe350070620 0x7fe3501411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 -- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe350149ef0 msgr2=0x7fe3500b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe350149ef0 0x7fe3500b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 -- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe350070620 msgr2=0x7fe3501411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe350070620 0x7fe3501411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 -- 172.21.15.16:0/3257442152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350141710 con 0x7fe3501483e0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34fe00640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe34800cb40 tx=0x7fe34800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348017070 con 0x7fe3501483e0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34800aca0 con 0x7fe3501483e0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348012620 con 0x7fe3501483e0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3500b1960 con 0x7fe3501483e0 2024-04-26T22:22:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3500b1c00 con 0x7fe3501483e0 2024-04-26T22:22:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe350069450 con 0x7fe3501483e0 2024-04-26T22:22:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe34801a070 con 0x7fe3501483e0 2024-04-26T22:22:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 0x7fe32c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fe3480862e0 con 0x7fe3501483e0 2024-04-26T22:22:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.641+0000 7fe34f400640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 0x7fe32c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.645+0000 7fe34f400640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 0x7fe32c06a8c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3400011f0 tx=0x7fe340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.645+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe350141710 con 0x7fe3501483e0 2024-04-26T22:22:29.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe3500737b0 con 0x7fe32c068400 2024-04-26T22:22:29.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe347e00640 1 -- 172.21.15.16:0/3257442152 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe3500737b0 con 0x7fe32c068400 2024-04-26T22:22:29.818 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T22:22:29.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 msgr2=0x7fe32c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 0x7fe32c06a8c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3400011f0 tx=0x7fe340009040 comp rx=0 tx=0).stop 2024-04-26T22:22:29.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 msgr2=0x7fe350148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe34800cb40 tx=0x7fe34800a060 comp rx=0 tx=0).stop 2024-04-26T22:22:29.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 shutdown_connections 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe32c068400 0x7fe32c06a8c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3501483e0 0x7fe350148870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe350149ef0 0x7fe3500b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 --2- 172.21.15.16:0/3257442152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe350070620 0x7fe3501411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 >> 172.21.15.16:0/3257442152 conn(0x7fe3500b6620 msgr2=0x7fe35006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 shutdown_connections 2024-04-26T22:22:29.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.813+0000 7fe356600640 1 -- 172.21.15.16:0/3257442152 wait complete. 2024-04-26T22:22:29.840 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T22:22:29.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.977+0000 7fc9b2a00640 1 Processor -- start 2024-04-26T22:22:29.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.977+0000 7fc9b2a00640 1 -- start start 2024-04-26T22:22:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b3490 0x7fc9ac0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc9ac0b6110 0x7fc9ac140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc9ac1498d0 0x7fc9ac06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ac0b5690 con 0x7fc9ac0b6110 2024-04-26T22:22:29.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ac0b3870 con 0x7fc9ac1498d0 2024-04-26T22:22:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac070560 con 0x7fc9ac0b3490 2024-04-26T22:22:29.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc9ac0b6110 0x7fc9ac140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9abe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b3490 0x7fc9ac0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc9ac0b6110 0x7fc9ac140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41406/0 (socket says 172.21.15.16:41406) 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 -- 172.21.15.16:0/2305119149 learned_addr learned my addr 172.21.15.16:0/2305119149 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9b0a00640 1 --2- 172.21.15.16:0/2305119149 >> v2:172.21.15.195:3300/0 conn(0x7fc9ac1498d0 0x7fc9ac06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 -- 172.21.15.16:0/2305119149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b3490 msgr2=0x7fc9ac0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 --2- 172.21.15.16:0/2305119149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b3490 0x7fc9ac0b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 -- 172.21.15.16:0/2305119149 >> v2:172.21.15.195:3300/0 conn(0x7fc9ac1498d0 msgr2=0x7fc9ac06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:29.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 --2- 172.21.15.16:0/2305119149 >> v2:172.21.15.195:3300/0 conn(0x7fc9ac1498d0 0x7fc9ac06ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.981+0000 7fc9a3400640 1 -- 172.21.15.16:0/2305119149 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac070840 con 0x7fc9ac0b6110 2024-04-26T22:22:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9a3400640 1 --2- 172.21.15.16:0/2305119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac0b6110 0x7fc9ac140280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac14a9f0 tx=0x7fc99401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db82513d236611b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9ab400640 1 -- 172.21.15.16:0/2305119149 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9940b0070 con 0x7fc9ac0b6110 2024-04-26T22:22:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9ab400640 1 -- 172.21.15.16:0/2305119149 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9940ab600 con 0x7fc9ac0b6110 2024-04-26T22:22:29.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9ab400640 1 -- 172.21.15.16:0/2305119149 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9940ab9d0 con 0x7fc9ac0b6110 2024-04-26T22:22:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- 172.21.15.16:0/2305119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac0b6110 msgr2=0x7fc9ac140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/2305119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac0b6110 0x7fc9ac140280 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac14a9f0 tx=0x7fc99401c490 comp rx=0 tx=0).stop 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- 172.21.15.16:0/2305119149 shutdown_connections 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/2305119149 >> v2:172.21.15.195:3300/0 conn(0x7fc9ac1498d0 0x7fc9ac06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/2305119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac0b6110 0x7fc9ac140280 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/2305119149 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b3490 0x7fc9ac0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- 172.21.15.16:0/2305119149 >> 172.21.15.16:0/2305119149 conn(0x7fc9ac0b6620 msgr2=0x7fc9ac0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- 172.21.15.16:0/2305119149 shutdown_connections 2024-04-26T22:22:29.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- 172.21.15.16:0/2305119149 wait complete. 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 Processor -- start 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- start start 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ac0b3490 0x7fc9ac0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b6110 0x7fc9ac13f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 0x7fc9ac13a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac152e80 con 0x7fc9ac1498d0 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac0b5ad0 con 0x7fc9ac0b3490 2024-04-26T22:22:29.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b2a00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac153000 con 0x7fc9ac0b6110 2024-04-26T22:22:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b0a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 0x7fc9ac13a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b0a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 0x7fc9ac13a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41408/0 (socket says 172.21.15.16:41408) 2024-04-26T22:22:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b6110 0x7fc9ac13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9b0a00640 1 -- 172.21.15.16:0/1598702530 learned_addr learned my addr 172.21.15.16:0/1598702530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:29.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.985+0000 7fc9abe00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ac0b3490 0x7fc9ac0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 -- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b6110 msgr2=0x7fc9ac13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc9ac0b6110 0x7fc9ac13f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 -- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ac0b3490 msgr2=0x7fc9ac0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:29.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc9ac0b3490 0x7fc9ac0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac13f350 con 0x7fc9ac1498d0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b0a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 0x7fc9ac13a890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e7c0 tx=0x7fc9a400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4017070 con 0x7fc9ac1498d0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a400ee70 con 0x7fc9ac1498d0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1465a0 con 0x7fc9ac1498d0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400cae0 con 0x7fc9ac1498d0 2024-04-26T22:22:29.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac147080 con 0x7fc9ac1498d0 2024-04-26T22:22:29.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9ac069530 con 0x7fc9ac1498d0 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9a401a070 con 0x7fc9ac1498d0 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc988068380 0x7fc98806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fc9a4086410 con 0x7fc9ac1498d0 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7fc98806e240 0x7fc988070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9a4022e50 con 0x7fc98806e240 2024-04-26T22:22:29.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.989+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc9a408d050 con 0x7fc9ac1498d0 2024-04-26T22:22:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.993+0000 7fc9a3400640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7fc98806e240 0x7fc988070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.993+0000 7fc9abe00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc988068380 0x7fc98806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.993+0000 7fc9a3400640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7fc98806e240 0x7fc988070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.993+0000 7fc9abe00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc988068380 0x7fc98806a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac13f2e0 tx=0x7fc99c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:29.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:29.993+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== osd.2 v2:172.21.15.16:6816/3412985029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9a4022e50 con 0x7fc98806e240 2024-04-26T22:22:30.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 --> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc9ac070c90 con 0x7fc98806e240 2024-04-26T22:22:30.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9a8c00640 1 -- 172.21.15.16:0/1598702530 <== osd.2 v2:172.21.15.16:6816/3412985029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc9ac070c90 con 0x7fc98806e240 2024-04-26T22:22:30.017 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:30.017 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:30.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7fc98806e240 msgr2=0x7fc988070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:6816/3412985029,v1:172.21.15.16:6817/3412985029] conn(0x7fc98806e240 0x7fc988070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc988068380 msgr2=0x7fc98806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fc988068380 0x7fc98806a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac13f2e0 tx=0x7fc99c00d040 comp rx=0 tx=0).stop 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 msgr2=0x7fc9ac13a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 --2- 172.21.15.16:0/1598702530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ac1498d0 0x7fc9ac13a890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e7c0 tx=0x7fc9a400ec80 comp rx=0 tx=0).stop 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b0a00640 1 -- 172.21.15.16:0/1598702530 reap_dead start 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 shutdown_connections 2024-04-26T22:22:30.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 >> 172.21.15.16:0/1598702530 conn(0x7fc9ac0b6620 msgr2=0x7fc9ac1501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 shutdown_connections 2024-04-26T22:22:30.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.005+0000 7fc9b2a00640 1 -- 172.21.15.16:0/1598702530 wait complete. 2024-04-26T22:22:30.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T22:22:30.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 Processor -- start 2024-04-26T22:22:30.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 -- start start 2024-04-26T22:22:30.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe2f80b8220 0x7fe2f80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f80b9280 con 0x7fe2f8149100 2024-04-26T22:22:30.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f8142d50 con 0x7fe2f80b8220 2024-04-26T22:22:30.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2fd400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f81494e0 con 0x7fe2f80b2a10 2024-04-26T22:22:30.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f6800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe2f8149100 0x7fe2f80b7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36324/0 (socket says 172.21.15.16:36324) 2024-04-26T22:22:30.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f6800640 1 -- 172.21.15.16:0/205743538 learned_addr learned my addr 172.21.15.16:0/205743538 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:30.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f7200640 1 --2- 172.21.15.16:0/205743538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2ede00640 1 --2- 172.21.15.16:0/205743538 >> v2:172.21.15.195:3300/0 conn(0x7fe2f80b8220 0x7fe2f80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f5e00640 1 -- 172.21.15.16:0/205743538 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453997160 0 0) 0x7fe2e80014a0 con 0x7fe2f8149100 2024-04-26T22:22:30.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f5e00640 1 -- 172.21.15.16:0/205743538 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2dc003530 con 0x7fe2f8149100 2024-04-26T22:22:30.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f7200640 1 -- 172.21.15.16:0/205743538 >> v2:172.21.15.195:3300/0 conn(0x7fe2f80b8220 msgr2=0x7fe2f80b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:30.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f7200640 1 --2- 172.21.15.16:0/205743538 >> v2:172.21.15.195:3300/0 conn(0x7fe2f80b8220 0x7fe2f80b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f7200640 1 -- 172.21.15.16:0/205743538 >> v1:172.21.15.16:6789/0 conn(0x7fe2f8149100 legacy=0x7fe2f80b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.169+0000 7fe2f7200640 1 -- 172.21.15.16:0/205743538 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f80b24c0 con 0x7fe2f80b2a10 2024-04-26T22:22:30.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.173+0000 7fe2f7200640 1 --2- 172.21.15.16:0/205743538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f8152e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097c0 tx=0x7fe2f001ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=609be976358a8973 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2f5e00640 1 -- 172.21.15.16:0/205743538 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b0070 con 0x7fe2f80b2a10 2024-04-26T22:22:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2f5e00640 1 -- 172.21.15.16:0/205743538 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f00ab600 con 0x7fe2f80b2a10 2024-04-26T22:22:30.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2f5e00640 1 -- 172.21.15.16:0/205743538 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00ab9d0 con 0x7fe2f80b2a10 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- 172.21.15.16:0/205743538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 msgr2=0x7fe2f8152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- 172.21.15.16:0/205743538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f8152e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00097c0 tx=0x7fe2f001ce70 comp rx=0 tx=0).stop 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- 172.21.15.16:0/205743538 shutdown_connections 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- 172.21.15.16:0/205743538 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f8152e30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- 172.21.15.16:0/205743538 >> v2:172.21.15.195:3300/0 conn(0x7fe2f80b8220 0x7fe2f80b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- 172.21.15.16:0/205743538 >> 172.21.15.16:0/205743538 conn(0x7fe2f80b8600 msgr2=0x7fe2f80b89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- 172.21.15.16:0/205743538 shutdown_connections 2024-04-26T22:22:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- 172.21.15.16:0/205743538 wait complete. 2024-04-26T22:22:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 Processor -- start 2024-04-26T22:22:30.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- start start 2024-04-26T22:22:30.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 0x7fe2f806c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f80b2220 con 0x7fe2f8149100 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f80b20a0 con 0x7fe2f80b8220 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.177+0000 7fe2fd400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f8155b90 con 0x7fe2f80b2a10 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41414/0 (socket says 172.21.15.16:41414) 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 -- 172.21.15.16:0/1736939361 learned_addr learned my addr 172.21.15.16:0/1736939361 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ede00640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 0x7fe2f806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f6800640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 -- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 msgr2=0x7fe2f806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 -- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 msgr2=0x7fe2f806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 0x7fe2f806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 -- 172.21.15.16:0/1736939361 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f8140ac0 con 0x7fe2f8149100 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ede00640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 0x7fe2f806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2f7200640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2f001aac0 tx=0x7fe2f00191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b8020 con 0x7fe2f8149100 2024-04-26T22:22:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f00abe30 con 0x7fe2f8149100 2024-04-26T22:22:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00b0040 con 0x7fe2f8149100 2024-04-26T22:22:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f813be10 con 0x7fe2f8149100 2024-04-26T22:22:30.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f8140d30 con 0x7fe2f8149100 2024-04-26T22:22:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8069450 con 0x7fe2f8149100 2024-04-26T22:22:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2f00bb020 con 0x7fe2f8149100 2024-04-26T22:22:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.181+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fe2f01201d0 con 0x7fe2f8149100 2024-04-26T22:22:30.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.185+0000 7fe2f6800640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.185+0000 7fe2f6800640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 0x7fe2d406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8005c10 tx=0x7fe2e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.185+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe2f00c2030 con 0x7fe2f8149100 2024-04-26T22:22:30.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe2f80b1e60 con 0x7fe2d4068380 2024-04-26T22:22:30.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2ef400640 1 -- 172.21.15.16:0/1736939361 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe2f80b1e60 con 0x7fe2d4068380 2024-04-26T22:22:30.358 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T22:22:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 msgr2=0x7fe2d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 0x7fe2d406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8005c10 tx=0x7fe2e8009040 comp rx=0 tx=0).stop 2024-04-26T22:22:30.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 msgr2=0x7fe2f81e0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe2f001aac0 tx=0x7fe2f00191b0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 shutdown_connections 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe2d4068380 0x7fe2d406a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f8149100 0x7fe2f81e0f90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2f80b8220 0x7fe2f806c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 --2- 172.21.15.16:0/1736939361 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2f80b2a10 0x7fe2f806ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 >> 172.21.15.16:0/1736939361 conn(0x7fe2f80b8600 msgr2=0x7fe2f806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 shutdown_connections 2024-04-26T22:22:30.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.353+0000 7fe2fd400640 1 -- 172.21.15.16:0/1736939361 wait complete. 2024-04-26T22:22:30.380 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T22:22:30.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:30.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.517+0000 7f1670e00640 1 Processor -- start 2024-04-26T22:22:30.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1670e00640 1 -- start start 2024-04-26T22:22:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1670e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f166c0a10b0 0x7f166c148be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1670e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0b7850 con 0x7f166c0a1530 2024-04-26T22:22:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1670e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0b6760 con 0x7f166c0b7470 2024-04-26T22:22:30.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1670e00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f166c0a0860 con 0x7f166c0a10b0 2024-04-26T22:22:30.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f166a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f166c0a1530 0x7f166c152e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36336/0 (socket says 172.21.15.16:36336) 2024-04-26T22:22:30.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f166a800640 1 -- 172.21.15.16:0/3639907663 learned_addr learned my addr 172.21.15.16:0/3639907663 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:30.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> v2:172.21.15.195:3300/0 conn(0x7f166c0a10b0 0x7f166c148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313777947 0 0) 0x7f166c0b7850 con 0x7f166c0a1530 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1650003530 con 0x7f166c0a1530 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822999002 0 0) 0x7f166c0b6760 con 0x7f166c0b7470 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c0b7850 con 0x7f166c0b7470 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3715046805 0 0) 0x7f1650003530 con 0x7f166c0a1530 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 >> v2:172.21.15.195:3300/0 conn(0x7f166c0a10b0 msgr2=0x7f166c148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 --2- 172.21.15.16:0/3639907663 >> v2:172.21.15.195:3300/0 conn(0x7f166c0a10b0 0x7f166c148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 >> v1:172.21.15.195:6789/0 conn(0x7f166c0b7470 legacy=0x7f166c0b7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0b6a40 con 0x7f166c0a1530 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f1664001680 con 0x7f166c0a1530 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> v2:172.21.15.195:3300/0 conn(0x7f166c0a10b0 0x7f166c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 >> v1:172.21.15.16:6789/0 conn(0x7f166c0a1530 legacy=0x7f166c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650003b50 0x7f1650003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 0x7f1650004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16500051d0 0x7f165000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0a0860 con 0x7f1650004810 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f165000c050 con 0x7f1650003b50 2024-04-26T22:22:30.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f165000c250 con 0x7f16500051d0 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 0x7f1650004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1669e00640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650003b50 0x7f1650003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f166a800640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16500051d0 0x7f165000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 -- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16500051d0 msgr2=0x7f165000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f16500051d0 0x7f165000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 -- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650003b50 msgr2=0x7f1650003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650003b50 0x7f1650003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f1661400640 1 -- 172.21.15.16:0/3639907663 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1650003530 con 0x7f1650004810 2024-04-26T22:22:30.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.521+0000 7f166a800640 1 -- 172.21.15.16:0/3639907663 reap_dead start 2024-04-26T22:22:30.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1661400640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 0x7f1650004c90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f165400e320 tx=0x7f165401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca9dd75556fe2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654009de0 con 0x7f1650004810 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540a5dd0 con 0x7f1650004810 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1669400640 1 -- 172.21.15.16:0/3639907663 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654003ba0 con 0x7f1650004810 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 -- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 msgr2=0x7f1650004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 0x7f1650004c90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f165400e320 tx=0x7f165401cdc0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 -- 172.21.15.16:0/3639907663 shutdown_connections 2024-04-26T22:22:30.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 --2- 172.21.15.16:0/3639907663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1650004810 0x7f1650004c90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 -- 172.21.15.16:0/3639907663 >> 172.21.15.16:0/3639907663 conn(0x7f166c0bbcc0 msgr2=0x7f166c0bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 -- 172.21.15.16:0/3639907663 shutdown_connections 2024-04-26T22:22:30.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.525+0000 7f1670e00640 1 -- 172.21.15.16:0/3639907663 wait complete. 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 Processor -- start 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- start start 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650004810 0x7f166c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 0x7f166c142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f166c145cd0 0x7f166c0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f166c148700 con 0x7f166c144e80 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f166c148580 con 0x7f1650004810 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f166c0b7ad0 con 0x7f166c145cd0 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 0x7f166c142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f166a800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f166c145cd0 0x7f166c0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 0x7f166c142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41432/0 (socket says 172.21.15.16:41432) 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 -- 172.21.15.16:0/1273787899 learned_addr learned my addr 172.21.15.16:0/1273787899 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1669e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650004810 0x7f166c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 -- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f166c145cd0 msgr2=0x7f166c0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f166c145cd0 0x7f166c0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 -- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650004810 msgr2=0x7f166c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1650004810 0x7f166c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0b1ae0 con 0x7f166c144e80 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1661400640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 0x7f166c142ef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f165401cbf0 tx=0x7f1650005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540a5bd0 con 0x7f166c144e80 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540b8470 con 0x7f166c144e80 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b8860 con 0x7f166c144e80 2024-04-26T22:22:30.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c1443a0 con 0x7f166c144e80 2024-04-26T22:22:30.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c144960 con 0x7f166c144e80 2024-04-26T22:22:30.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.529+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f166c069530 con 0x7f166c144e80 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f16540c0020 con 0x7f166c144e80 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f16480683b0 0x7f164806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f1654122350 con 0x7f166c144e80 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7f164806e270 0x7f1648070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1648070d40 con 0x7f164806e270 2024-04-26T22:22:30.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1654122700 con 0x7f166c144e80 2024-04-26T22:22:30.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1669e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f16480683b0 0x7f164806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f166a800640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7f164806e270 0x7f1648070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f166a800640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7f164806e270 0x7f1648070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1669e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f16480683b0 0x7f164806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f165c005630 tx=0x7f165c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.533+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== osd.3 v2:172.21.15.16:6824/700828209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1648070d40 con 0x7f164806e270 2024-04-26T22:22:30.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 --> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f166c149100 con 0x7f164806e270 2024-04-26T22:22:30.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1662a00640 1 -- 172.21.15.16:0/1273787899 <== osd.3 v2:172.21.15.16:6824/700828209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f166c149100 con 0x7f164806e270 2024-04-26T22:22:30.554 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:30.554 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:30.554 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:30.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7f164806e270 msgr2=0x7f1648070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:6824/700828209,v1:172.21.15.16:6825/700828209] conn(0x7f164806e270 0x7f1648070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f16480683b0 msgr2=0x7f164806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f16480683b0 0x7f164806a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f165c005630 tx=0x7f165c009040 comp rx=0 tx=0).stop 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 msgr2=0x7f166c142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 --2- 172.21.15.16:0/1273787899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f166c144e80 0x7f166c142ef0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f165401cbf0 tx=0x7f1650005840 comp rx=0 tx=0).stop 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f166a800640 1 -- 172.21.15.16:0/1273787899 reap_dead start 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 shutdown_connections 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 >> 172.21.15.16:0/1273787899 conn(0x7f166c0bbcc0 msgr2=0x7f166c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 shutdown_connections 2024-04-26T22:22:30.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.549+0000 7f1670e00640 1 -- 172.21.15.16:0/1273787899 wait complete. 2024-04-26T22:22:30.572 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T22:22:30.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 Processor -- start 2024-04-26T22:22:30.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 -- start start 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6040b7790 0x7fb60414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb604146140 con 0x7fb604148820 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040b7b70 con 0x7fb604145d10 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb608c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040aeaa0 con 0x7fb6040b7790 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6040b7790 0x7fb60414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6040b7790 0x7fb60414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41444/0 (socket says 172.21.15.16:41444) 2024-04-26T22:22:30.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 -- 172.21.15.16:0/1528427396 learned_addr learned my addr 172.21.15.16:0/1528427396 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:30.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb5f9400640 1 --1- 172.21.15.16:0/1528427396 >> v1:172.21.15.16:6789/0 conn(0x7fb604148820 0x7fb604145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36340/0 (socket says 172.21.15.16:36340) 2024-04-26T22:22:30.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 -- 172.21.15.16:0/1528427396 >> v1:172.21.15.195:6789/0 conn(0x7fb604145d10 legacy=0x7fb604152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:30.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 -- 172.21.15.16:0/1528427396 >> v1:172.21.15.16:6789/0 conn(0x7fb604148820 legacy=0x7fb604145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.709+0000 7fb601e00640 1 -- 172.21.15.16:0/1528427396 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60414c2f0 con 0x7fb6040b7790 2024-04-26T22:22:30.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb601e00640 1 --2- 172.21.15.16:0/1528427396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60414bc20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009870 tx=0x7fb5f401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d34aa10c46c050 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb601400640 1 -- 172.21.15.16:0/1528427396 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40ab660 con 0x7fb6040b7790 2024-04-26T22:22:30.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb601400640 1 -- 172.21.15.16:0/1528427396 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40b0070 con 0x7fb6040b7790 2024-04-26T22:22:30.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb601400640 1 -- 172.21.15.16:0/1528427396 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40aba20 con 0x7fb6040b7790 2024-04-26T22:22:30.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- 172.21.15.16:0/1528427396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 msgr2=0x7fb60414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 --2- 172.21.15.16:0/1528427396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60414bc20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009870 tx=0x7fb5f401c460 comp rx=0 tx=0).stop 2024-04-26T22:22:30.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- 172.21.15.16:0/1528427396 shutdown_connections 2024-04-26T22:22:30.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 --2- 172.21.15.16:0/1528427396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60414bc20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- 172.21.15.16:0/1528427396 >> 172.21.15.16:0/1528427396 conn(0x7fb60406cbc0 msgr2=0x7fb6040b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- 172.21.15.16:0/1528427396 shutdown_connections 2024-04-26T22:22:30.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- 172.21.15.16:0/1528427396 wait complete. 2024-04-26T22:22:30.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 Processor -- start 2024-04-26T22:22:30.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- start start 2024-04-26T22:22:30.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb604145d10 0x7fb604070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 0x7fb6041e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040ba100 con 0x7fb6040b7790 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040b9f80 con 0x7fb604148820 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.713+0000 7fb608c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb604156e90 con 0x7fb604145d10 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41450/0 (socket says 172.21.15.16:41450) 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 -- 172.21.15.16:0/1491721814 learned_addr learned my addr 172.21.15.16:0/1491721814 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb5f9400640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb604145d10 0x7fb604070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb602800640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 0x7fb6041e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 -- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb604145d10 msgr2=0x7fb604070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb604145d10 0x7fb604070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 -- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 msgr2=0x7fb6041e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 0x7fb6041e1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 -- 172.21.15.16:0/1491721814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb604072360 con 0x7fb6040b7790 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb602800640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 0x7fb6041e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb601e00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40ad040 tx=0x7fb5f401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b4800 con 0x7fb6040b7790 2024-04-26T22:22:30.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40b49c0 con 0x7fb6040b7790 2024-04-26T22:22:30.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b4db0 con 0x7fb6040b7790 2024-04-26T22:22:30.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60413cef0 con 0x7fb6040b7790 2024-04-26T22:22:30.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60413d1b0 con 0x7fb6040b7790 2024-04-26T22:22:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb604069450 con 0x7fb6040b7790 2024-04-26T22:22:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.717+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5f40c7440 con 0x7fb6040b7790 2024-04-26T22:22:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.721+0000 7fb5faa00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 0x7fb5e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.721+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fb5f41210f0 con 0x7fb6040b7790 2024-04-26T22:22:30.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.721+0000 7fb5f9400640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 0x7fb5e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:30.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.721+0000 7fb5f9400640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 0x7fb5e006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb604145280 tx=0x7fb5ec007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:30.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.725+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb5f4016110 con 0x7fb6040b7790 2024-04-26T22:22:30.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.889+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb60413cc40 con 0x7fb5e0068380 2024-04-26T22:22:30.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.889+0000 7fb5faa00640 1 -- 172.21.15.16:0/1491721814 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb60413cc40 con 0x7fb5e0068380 2024-04-26T22:22:30.895 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T22:22:30.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 msgr2=0x7fb5e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 0x7fb5e006a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb604145280 tx=0x7fb5ec007e90 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 msgr2=0x7fb60413c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40ad040 tx=0x7fb5f401aca0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 shutdown_connections 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fb5e0068380 0x7fb5e006a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb604148820 0x7fb6041e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb604145d10 0x7fb604070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 --2- 172.21.15.16:0/1491721814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6040b7790 0x7fb60413c700 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 >> 172.21.15.16:0/1491721814 conn(0x7fb60406cbc0 msgr2=0x7fb6041453d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 shutdown_connections 2024-04-26T22:22:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:30.893+0000 7fb608c00640 1 -- 172.21.15.16:0/1491721814 wait complete. 2024-04-26T22:22:30.916 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T22:22:30.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.053+0000 7f10ef800640 1 Processor -- start 2024-04-26T22:22:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ef800640 1 -- start start 2024-04-26T22:22:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ef800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 0x7f10e806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ef800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e81486d0 con 0x7f10e8142c10 2024-04-26T22:22:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ef800640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e8075e50 con 0x7f10e8075a70 2024-04-26T22:22:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ef800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10e80b59b0 con 0x7f10e81492a0 2024-04-26T22:22:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10dfe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f10e8142c10 0x7f10e8148b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36348/0 (socket says 172.21.15.16:36348) 2024-04-26T22:22:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10dfe00640 1 -- 172.21.15.16:0/1182835503 learned_addr learned my addr 172.21.15.16:0/1182835503 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ed800640 1 --2- 172.21.15.16:0/1182835503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 0x7f10e806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870793704 0 0) 0x7f10d0001120 con 0x7f10e8142c10 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10cc003530 con 0x7f10e8142c10 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570104557 0 0) 0x7f10e8075e50 con 0x7f10e8075a70 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d0001120 con 0x7f10e8075a70 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ed800640 1 -- 172.21.15.16:0/1182835503 >> v1:172.21.15.195:6789/0 conn(0x7f10e8075a70 legacy=0x7f10e8142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ed800640 1 -- 172.21.15.16:0/1182835503 >> v1:172.21.15.16:6789/0 conn(0x7f10e8142c10 legacy=0x7f10e8148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.057+0000 7f10ed800640 1 -- 172.21.15.16:0/1182835503 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e80b5c90 con 0x7f10e81492a0 2024-04-26T22:22:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ed800640 1 --2- 172.21.15.16:0/1182835503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 0x7f10e806ec50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009dc0 tx=0x7f10e001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b031828b441fe0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b2070 con 0x7f10e81492a0 2024-04-26T22:22:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a57c0 con 0x7f10e81492a0 2024-04-26T22:22:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10e7e00640 1 -- 172.21.15.16:0/1182835503 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00a5b90 con 0x7f10e81492a0 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 -- 172.21.15.16:0/1182835503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 msgr2=0x7f10e806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 --2- 172.21.15.16:0/1182835503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 0x7f10e806ec50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009dc0 tx=0x7f10e001c900 comp rx=0 tx=0).stop 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 -- 172.21.15.16:0/1182835503 shutdown_connections 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 --2- 172.21.15.16:0/1182835503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e81492a0 0x7f10e806ec50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 -- 172.21.15.16:0/1182835503 >> 172.21.15.16:0/1182835503 conn(0x7f10e809c100 msgr2=0x7f10e809c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 -- 172.21.15.16:0/1182835503 shutdown_connections 2024-04-26T22:22:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.061+0000 7f10ef800640 1 -- 172.21.15.16:0/1182835503 wait complete. 2024-04-26T22:22:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 Processor -- start 2024-04-26T22:22:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- start start 2024-04-26T22:22:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 0x7f10e8144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e8142c10 0x7f10e81e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e81492a0 0x7f10e809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8156bb0 con 0x7f10e8075a70 2024-04-26T22:22:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8156a30 con 0x7f10e81492a0 2024-04-26T22:22:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10e8156d30 con 0x7f10e8142c10 2024-04-26T22:22:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 0x7f10e8144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 0x7f10e8144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41462/0 (socket says 172.21.15.16:41462) 2024-04-26T22:22:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 -- 172.21.15.16:0/1532393580 learned_addr learned my addr 172.21.15.16:0/1532393580 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ed800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e81492a0 0x7f10e809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10dfe00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e8142c10 0x7f10e81e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 -- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e8142c10 msgr2=0x7f10e81e46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e8142c10 0x7f10e81e46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 -- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e81492a0 msgr2=0x7f10e809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e81492a0 0x7f10e809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e8144210 con 0x7f10e8075a70 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ed800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e81492a0 0x7f10e809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10dfe00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e8142c10 0x7f10e81e46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ece00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 0x7f10e8144a20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c500 tx=0x7f10d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8017070 con 0x7f10e8075a70 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8005310 con 0x7f10e8075a70 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d80054c0 con 0x7f10e8075a70 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e809d7f0 con 0x7f10e8075a70 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81431b0 con 0x7f10e8075a70 2024-04-26T22:22:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.065+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10e81e4c30 con 0x7f10e8075a70 2024-04-26T22:22:31.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10d801a070 con 0x7f10e8075a70 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f10c40683b0 0x7f10c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f10d8086440 con 0x7f10e8075a70 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7f10c406e270 0x7f10c4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10d8023e50 con 0x7f10c406e270 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10dfe00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f10c40683b0 0x7f10c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f10d80868d0 con 0x7f10e8075a70 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10ed800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7f10c406e270 0x7f10c4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10dfe00640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f10c40683b0 0x7f10c406a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10e8146610 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10ed800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7f10c406e270 0x7f10c4070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.069+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== osd.4 v2:172.21.15.195:6816/2204977921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10d8023e50 con 0x7f10c406e270 2024-04-26T22:22:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 --> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f10e8069530 con 0x7f10c406e270 2024-04-26T22:22:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10e5600640 1 -- 172.21.15.16:0/1532393580 <== osd.4 v2:172.21.15.195:6816/2204977921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f10e8069530 con 0x7f10c406e270 2024-04-26T22:22:31.091 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:31.091 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7f10c406e270 msgr2=0x7f10c4070690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6816/2204977921,v1:172.21.15.195:6818/2204977921] conn(0x7f10c406e270 0x7f10c4070690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f10c40683b0 msgr2=0x7f10c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f10c40683b0 0x7f10c406a870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f10e8146610 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 msgr2=0x7f10e8144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 --2- 172.21.15.16:0/1532393580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e8075a70 0x7f10e8144a20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c500 tx=0x7f10d800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ed800640 1 -- 172.21.15.16:0/1532393580 reap_dead start 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 shutdown_connections 2024-04-26T22:22:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 >> 172.21.15.16:0/1532393580 conn(0x7f10e809c100 msgr2=0x7f10e806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 shutdown_connections 2024-04-26T22:22:31.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.085+0000 7f10ef800640 1 -- 172.21.15.16:0/1532393580 wait complete. 2024-04-26T22:22:31.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T22:22:31.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 Processor -- start 2024-04-26T22:22:31.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 -- start start 2024-04-26T22:22:31.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 0x7f8210142520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82100a1cc0 0x7f82100a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8210070e70 con 0x7f82100b8420 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f821006fd70 con 0x7f82100a1cc0 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8218000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f821006ffc0 con 0x7f8210070a90 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82100a1cc0 0x7f82100a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82100a1cc0 0x7f82100a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41476/0 (socket says 172.21.15.16:41476) 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8216000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f82100b8420 0x7f821014baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36362/0 (socket says 172.21.15.16:36362) 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 -- 172.21.15.16:0/1858881038 learned_addr learned my addr 172.21.15.16:0/1858881038 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8215600640 1 --2- 172.21.15.16:0/1858881038 >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 0x7f8210142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 -- 172.21.15.16:0/1858881038 >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 msgr2=0x7f8210142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:31.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 --2- 172.21.15.16:0/1858881038 >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 0x7f8210142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 -- 172.21.15.16:0/1858881038 >> v1:172.21.15.16:6789/0 conn(0x7f82100b8420 legacy=0x7f821014baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8214c00640 1 -- 172.21.15.16:0/1858881038 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82100702a0 con 0x7f82100a1cc0 2024-04-26T22:22:31.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.245+0000 7f8215600640 1 --2- 172.21.15.16:0/1858881038 >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 0x7f8210142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:31.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8214c00640 1 --2- 172.21.15.16:0/1858881038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100a1cc0 0x7f82100a0df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f821006ebe0 tx=0x7f81fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2876804e59d668 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f820fe00640 1 -- 172.21.15.16:0/1858881038 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0a9400 con 0x7f82100a1cc0 2024-04-26T22:22:31.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f820fe00640 1 -- 172.21.15.16:0/1858881038 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc0a95a0 con 0x7f82100a1cc0 2024-04-26T22:22:31.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f820fe00640 1 -- 172.21.15.16:0/1858881038 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0a9970 con 0x7f82100a1cc0 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 -- 172.21.15.16:0/1858881038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100a1cc0 msgr2=0x7f82100a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 --2- 172.21.15.16:0/1858881038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100a1cc0 0x7f82100a0df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f821006ebe0 tx=0x7f81fc01c520 comp rx=0 tx=0).stop 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 -- 172.21.15.16:0/1858881038 shutdown_connections 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 --2- 172.21.15.16:0/1858881038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100a1cc0 0x7f82100a0df0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 --2- 172.21.15.16:0/1858881038 >> v2:172.21.15.195:3300/0 conn(0x7f8210070a90 0x7f8210142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 -- 172.21.15.16:0/1858881038 >> 172.21.15.16:0/1858881038 conn(0x7f8210072610 msgr2=0x7f8210072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 -- 172.21.15.16:0/1858881038 shutdown_connections 2024-04-26T22:22:31.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.249+0000 7f8218000640 1 -- 172.21.15.16:0/1858881038 wait complete. 2024-04-26T22:22:31.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 Processor -- start 2024-04-26T22:22:31.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- start start 2024-04-26T22:22:31.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 0x7f82101e4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 0x7f821006d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f82101561d0 con 0x7f82100b8420 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8210156050 con 0x7f8210070a90 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f8210156350 con 0x7f82100a1cc0 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41480/0 (socket says 172.21.15.16:41480) 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 -- 172.21.15.16:0/132614189 learned_addr learned my addr 172.21.15.16:0/132614189 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8215600640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 0x7f82101e4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8214c00640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 0x7f821006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 -- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 msgr2=0x7f821006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 0x7f821006d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 -- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 msgr2=0x7f82101e4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 0x7f82101e4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 -- 172.21.15.16:0/132614189 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821006d7f0 con 0x7f82100b8420 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8215600640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 0x7f82101e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8214c00640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 0x7f821006d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8216000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f820800c6c0 tx=0x7f820800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208018070 con 0x7f82100b8420 2024-04-26T22:22:31.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8208004d70 con 0x7f82100b8420 2024-04-26T22:22:31.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820800a840 con 0x7f82100b8420 2024-04-26T22:22:31.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8210140b30 con 0x7f82100b8420 2024-04-26T22:22:31.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821006dad0 con 0x7f82100b8420 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.253+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8210069450 con 0x7f82100b8420 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.257+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f820801b070 con 0x7f82100b8420 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.257+0000 7f820d600640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 0x7f81f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.257+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f8208085c50 con 0x7f82100b8420 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.257+0000 7f8215600640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 0x7f81f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.257+0000 7f8215600640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 0x7f81f006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8204009980 tx=0x7f8204008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.261+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f821006d7f0 con 0x7f82100b8420 2024-04-26T22:22:31.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f821013cea0 con 0x7f81f0068380 2024-04-26T22:22:31.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f820d600640 1 -- 172.21.15.16:0/132614189 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f821013cea0 con 0x7f81f0068380 2024-04-26T22:22:31.431 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T22:22:31.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 msgr2=0x7f81f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 0x7f81f006a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8204009980 tx=0x7f8204008040 comp rx=0 tx=0).stop 2024-04-26T22:22:31.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 msgr2=0x7f821006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f820800c6c0 tx=0x7f820800cb80 comp rx=0 tx=0).stop 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 shutdown_connections 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f81f0068380 0x7f81f006a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82100b8420 0x7f821006c400 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f82100a1cc0 0x7f821006d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.425+0000 7f8218000640 1 --2- 172.21.15.16:0/132614189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8210070a90 0x7f82101e4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.429+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 >> 172.21.15.16:0/132614189 conn(0x7f8210072610 msgr2=0x7f821013d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.429+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 shutdown_connections 2024-04-26T22:22:31.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.429+0000 7f8218000640 1 -- 172.21.15.16:0/132614189 wait complete. 2024-04-26T22:22:31.452 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T22:22:31.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:31.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.589+0000 7f670e800640 1 Processor -- start 2024-04-26T22:22:31.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.589+0000 7f670e800640 1 -- start start 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f670e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f670813f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f670e800640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 0x7f67081489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f670e800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67080b5c70 con 0x7f67080b3590 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f670e800640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f67080b19d0 con 0x7f67080b22f0 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f670e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f67080b1cb0 con 0x7f67080b5890 2024-04-26T22:22:31.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f67080b3590 0x7f670806ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36368/0 (socket says 172.21.15.16:36368) 2024-04-26T22:22:31.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707e00640 1 -- 172.21.15.16:0/1307338453 learned_addr learned my addr 172.21.15.16:0/1307338453 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:31.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707400640 1 --2- 172.21.15.16:0/1307338453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f670813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f66ffe00640 1 --2- 172.21.15.16:0/1307338453 >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 0x7f67081489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6706a00640 1 -- 172.21.15.16:0/1307338453 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274864927 0 0) 0x7f67080b5c70 con 0x7f67080b3590 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6706a00640 1 -- 172.21.15.16:0/1307338453 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ec003530 con 0x7f67080b3590 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707400640 1 -- 172.21.15.16:0/1307338453 >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 msgr2=0x7f67081489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707400640 1 --2- 172.21.15.16:0/1307338453 >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 0x7f67081489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707400640 1 -- 172.21.15.16:0/1307338453 >> v1:172.21.15.16:6789/0 conn(0x7f67080b3590 legacy=0x7f670806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f6707400640 1 -- 172.21.15.16:0/1307338453 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67080b1f90 con 0x7f67080b5890 2024-04-26T22:22:31.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.593+0000 7f66ffe00640 1 --2- 172.21.15.16:0/1307338453 >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 0x7f67081489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:31.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f6707400640 1 --2- 172.21.15.16:0/1307338453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f670813f170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f80097c0 tx=0x7f66f801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c05c2530c1c09fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f6706a00640 1 -- 172.21.15.16:0/1307338453 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80b5070 con 0x7f67080b5890 2024-04-26T22:22:31.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f6706a00640 1 -- 172.21.15.16:0/1307338453 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80a8990 con 0x7f67080b5890 2024-04-26T22:22:31.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f6706a00640 1 -- 172.21.15.16:0/1307338453 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a8d60 con 0x7f67080b5890 2024-04-26T22:22:31.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- 172.21.15.16:0/1307338453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 msgr2=0x7f670813f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 --2- 172.21.15.16:0/1307338453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f670813f170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66f80097c0 tx=0x7f66f801ec90 comp rx=0 tx=0).stop 2024-04-26T22:22:31.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- 172.21.15.16:0/1307338453 shutdown_connections 2024-04-26T22:22:31.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 --2- 172.21.15.16:0/1307338453 >> v2:172.21.15.195:3300/0 conn(0x7f67080b22f0 0x7f67081489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 --2- 172.21.15.16:0/1307338453 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f670813f170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- 172.21.15.16:0/1307338453 >> 172.21.15.16:0/1307338453 conn(0x7f67080b6620 msgr2=0x7f67080b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- 172.21.15.16:0/1307338453 shutdown_connections 2024-04-26T22:22:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- 172.21.15.16:0/1307338453 wait complete. 2024-04-26T22:22:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 Processor -- start 2024-04-26T22:22:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.597+0000 7f670e800640 1 -- start start 2024-04-26T22:22:31.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 0x7f670813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67080b3590 0x7f67080b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f67081480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f670813f830 con 0x7f67080b22f0 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f670813f6b0 con 0x7f67080b3590 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f670813f9b0 con 0x7f67080b5890 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 0x7f670813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 0x7f670813c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41482/0 (socket says 172.21.15.16:41482) 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 -- 172.21.15.16:0/4243428701 learned_addr learned my addr 172.21.15.16:0/4243428701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f66ffe00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67080b3590 0x7f67080b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707e00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f67081480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 -- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 msgr2=0x7f67081480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f67080b5890 0x7f67081480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 -- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67080b3590 msgr2=0x7f67080b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67080b3590 0x7f67080b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670813e020 con 0x7f67080b22f0 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f6707400640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 0x7f670813c630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f66f801d340 tx=0x7f66f801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80b5040 con 0x7f67080b22f0 2024-04-26T22:22:31.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80b0640 con 0x7f67080b22f0 2024-04-26T22:22:31.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80b0a10 con 0x7f67080b22f0 2024-04-26T22:22:31.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67080b9040 con 0x7f67080b22f0 2024-04-26T22:22:31.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670813e300 con 0x7f67080b22f0 2024-04-26T22:22:31.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67080b9280 con 0x7f67080b22f0 2024-04-26T22:22:31.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.601+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66f80b0bb0 con 0x7f67080b22f0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f66e4068380 0x7f66e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f66f81249a0 con 0x7f67080b22f0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f66e406e240 0x7f66e4070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66e4070d10 con 0x7f66e406e240 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66f8124d50 con 0x7f67080b22f0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ffe00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f66e4068380 0x7f66e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f6707e00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f66e406e240 0x7f66e4070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ffe00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f66e4068380 0x7f66e406a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009580 tx=0x7f66f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f6707e00640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f66e406e240 0x7f66e4070660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.605+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== osd.5 v2:172.21.15.195:6800/228290065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66e4070d10 con 0x7f66e406e240 2024-04-26T22:22:31.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.617+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 --> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67081d95e0 con 0x7f66e406e240 2024-04-26T22:22:31.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f66ff400640 1 -- 172.21.15.16:0/4243428701 <== osd.5 v2:172.21.15.195:6800/228290065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67081d95e0 con 0x7f66e406e240 2024-04-26T22:22:31.626 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:31.626 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:31.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f66e406e240 msgr2=0x7f66e4070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6800/228290065,v1:172.21.15.195:6801/228290065] conn(0x7f66e406e240 0x7f66e4070660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f66e4068380 msgr2=0x7f66e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f66e4068380 0x7f66e406a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009580 tx=0x7f66f0008040 comp rx=0 tx=0).stop 2024-04-26T22:22:31.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 msgr2=0x7f670813c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 --2- 172.21.15.16:0/4243428701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67080b22f0 0x7f670813c630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f66f801d340 tx=0x7f66f801ba30 comp rx=0 tx=0).stop 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f6707e00640 1 -- 172.21.15.16:0/4243428701 reap_dead start 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 shutdown_connections 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 >> 172.21.15.16:0/4243428701 conn(0x7f67080b6620 msgr2=0x7f6708143160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 shutdown_connections 2024-04-26T22:22:31.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.621+0000 7f670e800640 1 -- 172.21.15.16:0/4243428701 wait complete. 2024-04-26T22:22:31.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T22:22:31.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 Processor -- start 2024-04-26T22:22:31.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 -- start start 2024-04-26T22:22:31.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 0x7fef7c13f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7c13f9d0 con 0x7fef7c148980 2024-04-26T22:22:31.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fef7c0b2040 con 0x7fef7c0b5890 2024-04-26T22:22:31.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef84400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0b5c70 con 0x7fef7c13f050 2024-04-26T22:22:31.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 0x7fef7c13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81a00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58602/0 (socket says 172.21.15.16:58602) 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef82400640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fef7c148980 0x7fef7c148e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:57006/0 (socket says 172.21.15.16:57006) 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81a00640 1 -- 172.21.15.16:0/4294862597 learned_addr learned my addr 172.21.15.16:0/4294862597 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef7be00640 1 -- 172.21.15.16:0/4294862597 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851090347 0 0) 0x7fef7c13f9d0 con 0x7fef7c148980 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef7be00640 1 -- 172.21.15.16:0/4294862597 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef64005740 con 0x7fef7c148980 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81000640 1 -- 172.21.15.16:0/4294862597 >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 msgr2=0x7fef7c0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81000640 1 --2- 172.21.15.16:0/4294862597 >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81000640 1 -- 172.21.15.16:0/4294862597 >> v1:172.21.15.195:6789/0 conn(0x7fef7c148980 legacy=0x7fef7c148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81000640 1 -- 172.21.15.16:0/4294862597 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c0b19f0 con 0x7fef7c13f050 2024-04-26T22:22:31.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.781+0000 7fef81a00640 1 --2- 172.21.15.16:0/4294862597 >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:31.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef81000640 1 --2- 172.21.15.16:0/4294862597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 0x7fef7c13f490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0b21c0 tx=0x7fef6801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8732086bb08a9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef7be00640 1 -- 172.21.15.16:0/4294862597 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680b2070 con 0x7fef7c13f050 2024-04-26T22:22:31.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef7be00640 1 -- 172.21.15.16:0/4294862597 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef680ad640 con 0x7fef7c13f050 2024-04-26T22:22:31.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef7be00640 1 -- 172.21.15.16:0/4294862597 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680ada10 con 0x7fef7c13f050 2024-04-26T22:22:31.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 -- 172.21.15.16:0/4294862597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 msgr2=0x7fef7c13f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 --2- 172.21.15.16:0/4294862597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 0x7fef7c13f490 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0b21c0 tx=0x7fef6801c470 comp rx=0 tx=0).stop 2024-04-26T22:22:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 -- 172.21.15.16:0/4294862597 shutdown_connections 2024-04-26T22:22:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 --2- 172.21.15.16:0/4294862597 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c13f050 0x7fef7c13f490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 --2- 172.21.15.16:0/4294862597 >> v2:172.21.15.195:3300/0 conn(0x7fef7c0b5890 0x7fef7c0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 -- 172.21.15.16:0/4294862597 >> 172.21.15.16:0/4294862597 conn(0x7fef7c0b6620 msgr2=0x7fef7c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 -- 172.21.15.16:0/4294862597 shutdown_connections 2024-04-26T22:22:31.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.785+0000 7fef84400640 1 -- 172.21.15.16:0/4294862597 wait complete. 2024-04-26T22:22:31.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 Processor -- start 2024-04-26T22:22:31.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- start start 2024-04-26T22:22:31.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 0x7fef7c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef7c13f050 0x7fef7c13d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b4eb0 con 0x7fef7c148980 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c0b4d30 con 0x7fef7c13f050 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c0b5030 con 0x7fef7c0b5890 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41486/0 (socket says 172.21.15.16:41486) 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 -- 172.21.15.16:0/788471943 learned_addr learned my addr 172.21.15.16:0/788471943 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef81000640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef7c13f050 0x7fef7c13d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef81a00640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 0x7fef7c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 -- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 msgr2=0x7fef7c071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 0x7fef7c071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 -- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef7c13f050 msgr2=0x7fef7c13d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef7c13f050 0x7fef7c13d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 -- 172.21.15.16:0/788471943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c140c30 con 0x7fef7c148980 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef81a00640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 0x7fef7c071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef82400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c770 tx=0x7fef7400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74017070 con 0x7fef7c148980 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7400a640 con 0x7fef7c148980 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7400a9f0 con 0x7fef7c148980 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c141180 con 0x7fef7c148980 2024-04-26T22:22:31.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c140ea0 con 0x7fef7c148980 2024-04-26T22:22:31.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.789+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c0716c0 con 0x7fef7c148980 2024-04-26T22:22:31.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.793+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef7401a070 con 0x7fef7c148980 2024-04-26T22:22:31.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.793+0000 7fef79600640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 0x7fef5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:31.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.793+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fef74085bc0 con 0x7fef7c148980 2024-04-26T22:22:31.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.793+0000 7fef81a00640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 0x7fef5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:31.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.793+0000 7fef81a00640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 0x7fef5c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef70009630 tx=0x7fef70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:31.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.797+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fef74055e20 con 0x7fef7c148980 2024-04-26T22:22:31.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.961+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fef7c069450 con 0x7fef5c068380 2024-04-26T22:22:31.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef79600640 1 -- 172.21.15.16:0/788471943 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef7c069450 con 0x7fef5c068380 2024-04-26T22:22:31.969 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T22:22:31.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 msgr2=0x7fef5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 0x7fef5c06a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fef70009630 tx=0x7fef70008040 comp rx=0 tx=0).stop 2024-04-26T22:22:31.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 msgr2=0x7fef7c1e0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:31.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c770 tx=0x7fef7400cc30 comp rx=0 tx=0).stop 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 shutdown_connections 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fef5c068380 0x7fef5c06a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef7c148980 0x7fef7c1e0640 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef7c13f050 0x7fef7c13d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 --2- 172.21.15.16:0/788471943 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fef7c0b5890 0x7fef7c071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 >> 172.21.15.16:0/788471943 conn(0x7fef7c0b6620 msgr2=0x7fef7c0b88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 shutdown_connections 2024-04-26T22:22:31.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:31.965+0000 7fef84400640 1 -- 172.21.15.16:0/788471943 wait complete. 2024-04-26T22:22:31.990 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T22:22:31.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:32.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 Processor -- start 2024-04-26T22:22:32.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 -- start start 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f881c0b22f0 0x7f881c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b3590 0x7f881c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881c0b5c70 con 0x7f881c0b5890 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f881c0b19d0 con 0x7f881c0b22f0 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8823000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0b1cb0 con 0x7f881c0b3590 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f881c0b22f0 0x7f881c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f881c0b22f0 0x7f881c1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41500/0 (socket says 172.21.15.16:41500) 2024-04-26T22:22:32.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 -- 172.21.15.16:0/3330576026 learned_addr learned my addr 172.21.15.16:0/3330576026 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8821000640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b3590 0x7f881c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 -- 172.21.15.16:0/3330576026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b3590 msgr2=0x7f881c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b3590 0x7f881c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 -- 172.21.15.16:0/3330576026 >> v1:172.21.15.195:6789/0 conn(0x7f881c0b5890 legacy=0x7f881c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.129+0000 7f8813400640 1 -- 172.21.15.16:0/3330576026 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c0b1f90 con 0x7f881c0b22f0 2024-04-26T22:22:32.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8813400640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b22f0 0x7f881c1489a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f8804021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23299e34f5fd81b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f881b400640 1 -- 172.21.15.16:0/3330576026 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b6070 con 0x7f881c0b22f0 2024-04-26T22:22:32.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f881b400640 1 -- 172.21.15.16:0/3330576026 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88040b1400 con 0x7f881c0b22f0 2024-04-26T22:22:32.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f881b400640 1 -- 172.21.15.16:0/3330576026 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b17d0 con 0x7f881c0b22f0 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 -- 172.21.15.16:0/3330576026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b22f0 msgr2=0x7f881c1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b22f0 0x7f881c1489a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8804009e50 tx=0x7f8804021420 comp rx=0 tx=0).stop 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 -- 172.21.15.16:0/3330576026 shutdown_connections 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b3590 0x7f881c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 --2- 172.21.15.16:0/3330576026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b22f0 0x7f881c1489a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 -- 172.21.15.16:0/3330576026 >> 172.21.15.16:0/3330576026 conn(0x7f881c0b6620 msgr2=0x7f881c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 -- 172.21.15.16:0/3330576026 shutdown_connections 2024-04-26T22:22:32.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.133+0000 7f8823000640 1 -- 172.21.15.16:0/3330576026 wait complete. 2024-04-26T22:22:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 Processor -- start 2024-04-26T22:22:32.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- start start 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b22f0 0x7f881c13cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c0b3590 0x7f881c0b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 0x7f881c147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b11a0 con 0x7f881c0b5890 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b1020 con 0x7f881c0b3590 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0b4520 con 0x7f881c0b22f0 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 0x7f881c147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 0x7f881c147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41508/0 (socket says 172.21.15.16:41508) 2024-04-26T22:22:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 -- 172.21.15.16:0/4051664984 learned_addr learned my addr 172.21.15.16:0/4051664984 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8813400640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c0b3590 0x7f881c0b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f881be00640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b22f0 0x7f881c13cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 -- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b22f0 msgr2=0x7f881c13cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c0b22f0 0x7f881c13cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 -- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c0b3590 msgr2=0x7f881c0b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c0b3590 0x7f881c0b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c13e0c0 con 0x7f881c0b5890 2024-04-26T22:22:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8821000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 0x7f881c147ea0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f881400d5d0 tx=0x7f881400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88140125f0 con 0x7f881c0b5890 2024-04-26T22:22:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814019070 con 0x7f881c0b5890 2024-04-26T22:22:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88140129f0 con 0x7f881c0b5890 2024-04-26T22:22:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c13eae0 con 0x7f881c0b5890 2024-04-26T22:22:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c148550 con 0x7f881c0b5890 2024-04-26T22:22:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.137+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f881c069530 con 0x7f881c0b5890 2024-04-26T22:22:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8814012b90 con 0x7f881c0b5890 2024-04-26T22:22:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f87f8068380 0x7f87f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f8814087550 con 0x7f881c0b5890 2024-04-26T22:22:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f87f806e240 0x7f87f8070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8814001d40 con 0x7f87f806e240 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8814087900 con 0x7f881c0b5890 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f881be00640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f87f8068380 0x7f87f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8813400640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f87f806e240 0x7f87f8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f881be00640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f87f8068380 0x7f87f806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f70 tx=0x7f880c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8813400640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f87f806e240 0x7f87f8070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.141+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== osd.6 v2:172.21.15.195:6817/3327636089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8814001d40 con 0x7f87f806e240 2024-04-26T22:22:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 --> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f881c147ac0 con 0x7f87f806e240 2024-04-26T22:22:32.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8818c00640 1 -- 172.21.15.16:0/4051664984 <== osd.6 v2:172.21.15.195:6817/3327636089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f881c147ac0 con 0x7f87f806e240 2024-04-26T22:22:32.162 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:32.162 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:32.163 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f87f806e240 msgr2=0x7f87f8070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6817/3327636089,v1:172.21.15.195:6819/3327636089] conn(0x7f87f806e240 0x7f87f8070660 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f87f8068380 msgr2=0x7f87f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f87f8068380 0x7f87f806a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f70 tx=0x7f880c009040 comp rx=0 tx=0).stop 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 msgr2=0x7f881c147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 --2- 172.21.15.16:0/4051664984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f881c0b5890 0x7f881c147ea0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f881400d5d0 tx=0x7f881400da90 comp rx=0 tx=0).stop 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8821000640 1 -- 172.21.15.16:0/4051664984 reap_dead start 2024-04-26T22:22:32.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 shutdown_connections 2024-04-26T22:22:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 >> 172.21.15.16:0/4051664984 conn(0x7f881c0b6620 msgr2=0x7f881c1433a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 shutdown_connections 2024-04-26T22:22:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.157+0000 7f8823000640 1 -- 172.21.15.16:0/4051664984 wait complete. 2024-04-26T22:22:32.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T22:22:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 Processor -- start 2024-04-26T22:22:32.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 -- start start 2024-04-26T22:22:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24fc0a0c00 0x7f24fc153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc0b0a10 con 0x7f24fc0b1760 2024-04-26T22:22:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc0b6a90 con 0x7f24fc0b66b0 2024-04-26T22:22:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2502e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc0b0f90 con 0x7f24fc0a0c00 2024-04-26T22:22:32.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24fc0a0c00 0x7f24fc153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24fc0a0c00 0x7f24fc153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41524/0 (socket says 172.21.15.16:41524) 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f24f3400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f24fc0b1760 0x7f24fc148eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36372/0 (socket says 172.21.15.16:36372) 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 -- 172.21.15.16:0/2006104349 learned_addr learned my addr 172.21.15.16:0/2006104349 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 -- 172.21.15.16:0/2006104349 >> v1:172.21.15.195:6789/0 conn(0x7f24fc0b66b0 legacy=0x7f24fc06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 -- 172.21.15.16:0/2006104349 >> v1:172.21.15.16:6789/0 conn(0x7f24fc0b1760 legacy=0x7f24fc148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.317+0000 7f2500e00640 1 -- 172.21.15.16:0/2006104349 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc0b0cb0 con 0x7f24fc0a0c00 2024-04-26T22:22:32.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2500e00640 1 --2- 172.21.15.16:0/2006104349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0a0c00 0x7f24fc153eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009e50 tx=0x7f24f401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0845bdf214963e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f24fb400640 1 -- 172.21.15.16:0/2006104349 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a57c0 con 0x7f24fc0a0c00 2024-04-26T22:22:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f24fb400640 1 -- 172.21.15.16:0/2006104349 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40a5960 con 0x7f24fc0a0c00 2024-04-26T22:22:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f24fb400640 1 -- 172.21.15.16:0/2006104349 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a5d30 con 0x7f24fc0a0c00 2024-04-26T22:22:32.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 -- 172.21.15.16:0/2006104349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0a0c00 msgr2=0x7f24fc153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 --2- 172.21.15.16:0/2006104349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0a0c00 0x7f24fc153eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009e50 tx=0x7f24f401c8e0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 -- 172.21.15.16:0/2006104349 shutdown_connections 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 --2- 172.21.15.16:0/2006104349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0a0c00 0x7f24fc153eb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 -- 172.21.15.16:0/2006104349 >> 172.21.15.16:0/2006104349 conn(0x7f24fc06c400 msgr2=0x7f24fc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 -- 172.21.15.16:0/2006104349 shutdown_connections 2024-04-26T22:22:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.321+0000 7f2502e00640 1 -- 172.21.15.16:0/2006104349 wait complete. 2024-04-26T22:22:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 Processor -- start 2024-04-26T22:22:32.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- start start 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24fc0a0c00 0x7f24fc143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24fc0b1760 0x7f24fc1e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc149740 con 0x7f24fc0b66b0 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc1495c0 con 0x7f24fc0a0c00 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc156c10 con 0x7f24fc0b1760 2024-04-26T22:22:32.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41526/0 (socket says 172.21.15.16:41526) 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 -- 172.21.15.16:0/3112499350 learned_addr learned my addr 172.21.15.16:0/3112499350 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f24f3400640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24fc0b1760 0x7f24fc1e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f24fbe00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24fc0a0c00 0x7f24fc143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 -- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24fc0b1760 msgr2=0x7f24fc1e0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24fc0b1760 0x7f24fc1e0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 -- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24fc0a0c00 msgr2=0x7f24fc143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24fc0a0c00 0x7f24fc143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 -- 172.21.15.16:0/3112499350 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc144c50 con 0x7f24fc0b66b0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2500e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f24f40194f0 tx=0x7f24f4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40bc020 con 0x7f24fc0b66b0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40b86b0 con 0x7f24fc0b66b0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f40b8aa0 con 0x7f24fc0b66b0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc144f30 con 0x7f24fc0b66b0 2024-04-26T22:22:32.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.325+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc143080 con 0x7f24fc0b66b0 2024-04-26T22:22:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc0b3e70 con 0x7f24fc0b66b0 2024-04-26T22:22:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24f40bf020 con 0x7f24fc0b66b0 2024-04-26T22:22:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f24f8c00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 0x7f24d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f24f41219f0 con 0x7f24fc0b66b0 2024-04-26T22:22:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f24fbe00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 0x7f24d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.329+0000 7f24fbe00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 0x7f24d806a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24fc13e590 tx=0x7f24ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.333+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f24f4016620 con 0x7f24fc0b66b0 2024-04-26T22:22:32.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f24fc0afd60 con 0x7f24d8068380 2024-04-26T22:22:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f24f8c00640 1 -- 172.21.15.16:0/3112499350 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f24fc0afd60 con 0x7f24d8068380 2024-04-26T22:22:32.507 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 msgr2=0x7f24d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 0x7f24d806a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f24fc13e590 tx=0x7f24ec009040 comp rx=0 tx=0).stop 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 msgr2=0x7f24fc146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f24f40194f0 tx=0x7f24f4019680 comp rx=0 tx=0).stop 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 shutdown_connections 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24d8068380 0x7f24d806a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24fc0b66b0 0x7f24fc146460 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24fc0b1760 0x7f24fc1e0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 --2- 172.21.15.16:0/3112499350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24fc0a0c00 0x7f24fc143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 >> 172.21.15.16:0/3112499350 conn(0x7f24fc06c400 msgr2=0x7f24fc141650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 shutdown_connections 2024-04-26T22:22:32.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.501+0000 7f2502e00640 1 -- 172.21.15.16:0/3112499350 wait complete. 2024-04-26T22:22:32.529 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T22:22:32.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:22:32.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 Processor -- start 2024-04-26T22:22:32.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 -- start start 2024-04-26T22:22:32.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 0x7f3d980b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d980b3370 con 0x7f3d980b6480 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f3d980b7a40 con 0x7f3d980b6860 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d9d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d980b35e0 con 0x7f3d980bc5a0 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d97e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 0x7f3d980b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:57858/0 (socket says 172.21.15.16:57858) 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d97e00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 0x7f3d980b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.16:58634/0 (socket says 172.21.15.16:58634) 2024-04-26T22:22:32.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 -- 172.21.15.16:0/3224548594 learned_addr learned my addr 172.21.15.16:0/3224548594 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d97400640 1 --1- 172.21.15.16:0/3224548594 >> v1:172.21.15.195:6789/0 conn(0x7f3d980b6480 0x7f3d981461b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:57036/0 (socket says 172.21.15.16:57036) 2024-04-26T22:22:32.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 -- 172.21.15.16:0/3224548594 >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 msgr2=0x7f3d980b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:32.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 --2- 172.21.15.16:0/3224548594 >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 0x7f3d980b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 -- 172.21.15.16:0/3224548594 >> v1:172.21.15.195:6789/0 conn(0x7f3d980b6480 legacy=0x7f3d981461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.669+0000 7f3d96a00640 1 -- 172.21.15.16:0/3224548594 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d980b7710 con 0x7f3d980bc5a0 2024-04-26T22:22:32.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d96a00640 1 --2- 172.21.15.16:0/3224548594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009870 tx=0x7f3d8401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41fc937cd27ca1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d96000640 1 -- 172.21.15.16:0/3224548594 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840b1070 con 0x7f3d980bc5a0 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d96000640 1 -- 172.21.15.16:0/3224548594 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d840a8050 con 0x7f3d980bc5a0 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d96000640 1 -- 172.21.15.16:0/3224548594 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840ac860 con 0x7f3d980bc5a0 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- 172.21.15.16:0/3224548594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 msgr2=0x7f3d980b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 --2- 172.21.15.16:0/3224548594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009870 tx=0x7f3d8401c4d0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- 172.21.15.16:0/3224548594 shutdown_connections 2024-04-26T22:22:32.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 --2- 172.21.15.16:0/3224548594 >> v2:172.21.15.195:3300/0 conn(0x7f3d980b6860 0x7f3d980b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 --2- 172.21.15.16:0/3224548594 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980bc5a0 0x7f3d980b5020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- 172.21.15.16:0/3224548594 >> 172.21.15.16:0/3224548594 conn(0x7f3d980bba80 msgr2=0x7f3d980bbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- 172.21.15.16:0/3224548594 shutdown_connections 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- 172.21.15.16:0/3224548594 wait complete. 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 Processor -- start 2024-04-26T22:22:32.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.673+0000 7f3d9d000640 1 -- start start 2024-04-26T22:22:32.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 0x7f3d9806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980b6860 0x7f3d981415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d981e4260 0x7f3d98141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d98153600 con 0x7f3d980b6480 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f3d98153480 con 0x7f3d981e4260 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f3d98153780 con 0x7f3d980b6860 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 0x7f3d9806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 0x7f3d9806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41536/0 (socket says 172.21.15.16:41536) 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 -- 172.21.15.16:0/2128699279 learned_addr learned my addr 172.21.15.16:0/2128699279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97e00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d981e4260 0x7f3d98141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d96a00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980b6860 0x7f3d981415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 -- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980b6860 msgr2=0x7f3d981415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d980b6860 0x7f3d981415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 -- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d981e4260 msgr2=0x7f3d98141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d981e4260 0x7f3d98141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d980bb460 con 0x7f3d980b6480 2024-04-26T22:22:32.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97e00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d981e4260 0x7f3d98141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d97400640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 0x7f3d9806d6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3a0 tx=0x7f3d8800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d880074e0 con 0x7f3d980b6480 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88007680 con 0x7f3d980b6480 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004a30 con 0x7f3d980b6480 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d981e47f0 con 0x7f3d980b6480 2024-04-26T22:22:32.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9814a4a0 con 0x7f3d980b6480 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d98069450 con 0x7f3d980b6480 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.677+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d8801a020 con 0x7f3d980b6480 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d78068380 0x7f3d7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f3d88085dc0 con 0x7f3d980b6480 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f3d7806e240 0x7f3d78070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d88015e50 con 0x7f3d7806e240 2024-04-26T22:22:32.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3d88088380 con 0x7f3d980b6480 2024-04-26T22:22:32.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d96a00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d78068380 0x7f3d7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d97e00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f3d7806e240 0x7f3d78070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d96a00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d78068380 0x7f3d7806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d840ae000 tx=0x7f3d840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d97e00640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f3d7806e240 0x7f3d78070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.681+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== osd.7 v2:172.21.15.195:6808/4215805328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d88015e50 con 0x7f3d7806e240 2024-04-26T22:22:32.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 --> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d98149ed0 con 0x7f3d7806e240 2024-04-26T22:22:32.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d8f400640 1 -- 172.21.15.16:0/2128699279 <== osd.7 v2:172.21.15.195:6808/4215805328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d98149ed0 con 0x7f3d7806e240 2024-04-26T22:22:32.702 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T22:22:32.703 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:22:32.703 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T22:22:32.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f3d7806e240 msgr2=0x7f3d78070660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6808/4215805328,v1:172.21.15.195:6809/4215805328] conn(0x7f3d7806e240 0x7f3d78070660 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d78068380 msgr2=0x7f3d7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f3d78068380 0x7f3d7806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d840ae000 tx=0x7f3d840a7000 comp rx=0 tx=0).stop 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 msgr2=0x7f3d9806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 --2- 172.21.15.16:0/2128699279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d980b6480 0x7f3d9806d6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3a0 tx=0x7f3d8800c860 comp rx=0 tx=0).stop 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d97e00640 1 -- 172.21.15.16:0/2128699279 reap_dead start 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 shutdown_connections 2024-04-26T22:22:32.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 >> 172.21.15.16:0/2128699279 conn(0x7f3d980bba80 msgr2=0x7f3d980bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 shutdown_connections 2024-04-26T22:22:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.697+0000 7f3d9d000640 1 -- 172.21.15.16:0/2128699279 wait complete. 2024-04-26T22:22:32.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T22:22:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 Processor -- start 2024-04-26T22:22:32.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 -- start start 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f619c0b5890 0x7f619c0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 0x7f619c13f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c13f9d0 con 0x7f619c148980 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f619c0b2040 con 0x7f619c0b5890 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a3c00640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f619c0b5c70 con 0x7f619c13f050 2024-04-26T22:22:32.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f619c0b5890 0x7f619c0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f619c0b5890 0x7f619c0b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41538/0 (socket says 172.21.15.16:41538) 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a1200640 1 -- 172.21.15.16:0/538249757 learned_addr learned my addr 172.21.15.16:0/538249757 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f61a1c00640 1 --1- 172.21.15.16:0/538249757 >> v1:172.21.15.16:6789/0 conn(0x7f619c148980 0x7f619c148e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36384/0 (socket says 172.21.15.16:36384) 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.857+0000 7f6193e00640 1 --2- 172.21.15.16:0/538249757 >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 0x7f619c13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a1200640 1 -- 172.21.15.16:0/538249757 >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 msgr2=0x7f619c13f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a1200640 1 --2- 172.21.15.16:0/538249757 >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 0x7f619c13f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a1200640 1 -- 172.21.15.16:0/538249757 >> v1:172.21.15.16:6789/0 conn(0x7f619c148980 legacy=0x7f619c148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a1200640 1 -- 172.21.15.16:0/538249757 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c0b19f0 con 0x7f619c0b5890 2024-04-26T22:22:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f619be00640 1 -- 172.21.15.16:0/538249757 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937865156 0 0) 0x7f619c13f9d0 con 0x7f619c148980 2024-04-26T22:22:32.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f6193e00640 1 --2- 172.21.15.16:0/538249757 >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 0x7f619c13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:22:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a1200640 1 --2- 172.21.15.16:0/538249757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c0b5890 0x7f619c0b3000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f619c0705f0 tx=0x7f618c01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39165266ec9f44b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f619be00640 1 -- 172.21.15.16:0/538249757 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c0b4070 con 0x7f619c0b5890 2024-04-26T22:22:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f619be00640 1 -- 172.21.15.16:0/538249757 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618c0a7bb0 con 0x7f619c0b5890 2024-04-26T22:22:32.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f619be00640 1 -- 172.21.15.16:0/538249757 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c0af440 con 0x7f619c0b5890 2024-04-26T22:22:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 -- 172.21.15.16:0/538249757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c0b5890 msgr2=0x7f619c0b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 --2- 172.21.15.16:0/538249757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c0b5890 0x7f619c0b3000 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f619c0705f0 tx=0x7f618c01ebc0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 -- 172.21.15.16:0/538249757 shutdown_connections 2024-04-26T22:22:32.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 --2- 172.21.15.16:0/538249757 >> v2:172.21.15.195:3300/0 conn(0x7f619c13f050 0x7f619c13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 --2- 172.21.15.16:0/538249757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c0b5890 0x7f619c0b3000 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 -- 172.21.15.16:0/538249757 >> 172.21.15.16:0/538249757 conn(0x7f619c0b6620 msgr2=0x7f619c0b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 -- 172.21.15.16:0/538249757 shutdown_connections 2024-04-26T22:22:32.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.861+0000 7f61a3c00640 1 -- 172.21.15.16:0/538249757 wait complete. 2024-04-26T22:22:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 Processor -- start 2024-04-26T22:22:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- start start 2024-04-26T22:22:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f619c0b5890 0x7f619c141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f619c13f050 0x7f619c1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0b4eb0 con 0x7f619c148980 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0b4d30 con 0x7f619c0b5890 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f619c0b5030 con 0x7f619c13f050 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41554/0 (socket says 172.21.15.16:41554) 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 -- 172.21.15.16:0/1080893215 learned_addr learned my addr 172.21.15.16:0/1080893215 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:32.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1200640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f619c0b5890 0x7f619c141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f6193e00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f619c13f050 0x7f619c1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 -- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f619c13f050 msgr2=0x7f619c1430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f619c13f050 0x7f619c1430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 -- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f619c0b5890 msgr2=0x7f619c141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f619c0b5890 0x7f619c141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 -- 172.21.15.16:0/1080893215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c144fa0 con 0x7f619c148980 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a1c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f619400c730 tx=0x7f619400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194018070 con 0x7f619c148980 2024-04-26T22:22:32.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619400ce40 con 0x7f619c148980 2024-04-26T22:22:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619c072370 con 0x7f619c148980 2024-04-26T22:22:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619400a860 con 0x7f619c148980 2024-04-26T22:22:32.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.865+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619c144cc0 con 0x7f619c148980 2024-04-26T22:22:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619c069450 con 0x7f619c148980 2024-04-26T22:22:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f619401b070 con 0x7f619c148980 2024-04-26T22:22:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f6199600640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 0x7f617806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f6194085b60 con 0x7f619c148980 2024-04-26T22:22:32.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f61a1200640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 0x7f617806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:32.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.869+0000 7f61a1200640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 0x7f617806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b1000 tx=0x7f618c0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:32.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:32.873+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f61940564b0 con 0x7f619c148980 2024-04-26T22:22:33.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.041+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f619c072090 con 0x7f6178068380 2024-04-26T22:22:33.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.041+0000 7f6199600640 1 -- 172.21.15.16:0/1080893215 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f619c072090 con 0x7f6178068380 2024-04-26T22:22:33.048 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T22:22:33.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 msgr2=0x7f617806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 0x7f617806a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f618c0b1000 tx=0x7f618c0a9070 comp rx=0 tx=0).stop 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 msgr2=0x7f619c143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f619400c730 tx=0x7f619400cbf0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 shutdown_connections 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f6178068380 0x7f617806a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f619c148980 0x7f619c143610 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f619c13f050 0x7f619c1430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 --2- 172.21.15.16:0/1080893215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f619c0b5890 0x7f619c141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 >> 172.21.15.16:0/1080893215 conn(0x7f619c0b6620 msgr2=0x7f619c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:33.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 shutdown_connections 2024-04-26T22:22:33.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.045+0000 7f61a3c00640 1 -- 172.21.15.16:0/1080893215 wait complete. 2024-04-26T22:22:33.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:33.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 Processor -- start 2024-04-26T22:22:33.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 -- start start 2024-04-26T22:22:33.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45040a0bb0 0x7f45040708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45041489c0 0x7f4504152e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45040700f0 con 0x7f45040a07d0 2024-04-26T22:22:33.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4504070420 con 0x7f45041489c0 2024-04-26T22:22:33.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.205+0000 7f4509000640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f4504149330 con 0x7f45040a0bb0 2024-04-26T22:22:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45041489c0 0x7f4504152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4501e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f45040a07d0 0x7f4504073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36392/0 (socket says 172.21.15.16:36392) 2024-04-26T22:22:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4501e00640 1 -- 172.21.15.16:0/3799960075 learned_addr learned my addr 172.21.15.16:0/3799960075 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f44f9400640 1 --2- 172.21.15.16:0/3799960075 >> v2:172.21.15.195:3300/0 conn(0x7f45040a0bb0 0x7f45040708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 -- 172.21.15.16:0/3799960075 >> v2:172.21.15.195:3300/0 conn(0x7f45040a0bb0 msgr2=0x7f45040708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:33.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 --2- 172.21.15.16:0/3799960075 >> v2:172.21.15.195:3300/0 conn(0x7f45040a0bb0 0x7f45040708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 -- 172.21.15.16:0/3799960075 >> v1:172.21.15.16:6789/0 conn(0x7f45040a07d0 legacy=0x7f4504073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 -- 172.21.15.16:0/3799960075 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4504071140 con 0x7f45041489c0 2024-04-26T22:22:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4502800640 1 --2- 172.21.15.16:0/3799960075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45041489c0 0x7f4504152e20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f450406fd60 tx=0x7f44fc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8a01905eb4d7fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4501400640 1 -- 172.21.15.16:0/3799960075 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0b2070 con 0x7f45041489c0 2024-04-26T22:22:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4501400640 1 -- 172.21.15.16:0/3799960075 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc0a5980 con 0x7f45041489c0 2024-04-26T22:22:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.209+0000 7f4501400640 1 -- 172.21.15.16:0/3799960075 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0a5d50 con 0x7f45041489c0 2024-04-26T22:22:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- 172.21.15.16:0/3799960075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45041489c0 msgr2=0x7f4504152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- 172.21.15.16:0/3799960075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45041489c0 0x7f4504152e20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f450406fd60 tx=0x7f44fc01c8a0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- 172.21.15.16:0/3799960075 shutdown_connections 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- 172.21.15.16:0/3799960075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45041489c0 0x7f4504152e20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- 172.21.15.16:0/3799960075 >> v2:172.21.15.195:3300/0 conn(0x7f45040a0bb0 0x7f45040708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- 172.21.15.16:0/3799960075 >> 172.21.15.16:0/3799960075 conn(0x7f45040b87c0 msgr2=0x7f45040b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- 172.21.15.16:0/3799960075 shutdown_connections 2024-04-26T22:22:33.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- 172.21.15.16:0/3799960075 wait complete. 2024-04-26T22:22:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 Processor -- start 2024-04-26T22:22:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- start start 2024-04-26T22:22:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45040a0bb0 0x7f4504146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45041489c0 0x7f4504147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4504155b80 con 0x7f45040a07d0 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f4504149080 con 0x7f45040a0bb0 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4509000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f4504155d00 con 0x7f45041489c0 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41572/0 (socket says 172.21.15.16:41572) 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 -- 172.21.15.16:0/1666911902 learned_addr learned my addr 172.21.15.16:0/1666911902 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:33.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f44f9400640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45040a0bb0 0x7f4504146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4502800640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45041489c0 0x7f4504147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 -- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45041489c0 msgr2=0x7f4504147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45041489c0 0x7f4504147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 -- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45040a0bb0 msgr2=0x7f4504146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45040a0bb0 0x7f4504146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 -- 172.21.15.16:0/1666911902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4504142df0 con 0x7f45040a07d0 2024-04-26T22:22:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f4501e00640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c370 tx=0x7f44f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.213+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4017070 con 0x7f45040a07d0 2024-04-26T22:22:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f4005cf0 con 0x7f45040a07d0 2024-04-26T22:22:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40072f0 con 0x7f45040a07d0 2024-04-26T22:22:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45041430d0 con 0x7f45040a07d0 2024-04-26T22:22:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450413c170 con 0x7f45040a07d0 2024-04-26T22:22:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4504069530 con 0x7f45040a07d0 2024-04-26T22:22:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44f401a070 con 0x7f45040a07d0 2024-04-26T22:22:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44faa00640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f44f4085a20 con 0x7f45040a07d0 2024-04-26T22:22:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.217+0000 7f44f9400640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.221+0000 7f44f9400640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 0x7f44e006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f450413a410 tx=0x7f44ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.221+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f44f40562d0 con 0x7f45040a07d0 2024-04-26T22:22:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.385+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45040bae50 con 0x7f44e0068380 2024-04-26T22:22:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f44faa00640 1 -- 172.21.15.16:0/1666911902 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13459 (secure 0 0 0) 0x7f45040bae50 con 0x7f44e0068380 2024-04-26T22:22:33.394 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:33.394 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 msgr2=0x7f44e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 0x7f44e006a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f450413a410 tx=0x7f44ec008040 comp rx=0 tx=0).stop 2024-04-26T22:22:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 msgr2=0x7f450413b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c370 tx=0x7f44f400c830 comp rx=0 tx=0).stop 2024-04-26T22:22:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 shutdown_connections 2024-04-26T22:22:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f44e0068380 0x7f44e006a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45041489c0 0x7f4504147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45040a0bb0 0x7f4504146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 --2- 172.21.15.16:0/1666911902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45040a07d0 0x7f450413b9d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 >> 172.21.15.16:0/1666911902 conn(0x7f45040b87c0 msgr2=0x7f4504072630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 shutdown_connections 2024-04-26T22:22:33.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:33.389+0000 7f4509000640 1 -- 172.21.15.16:0/1666911902 wait complete. 2024-04-26T22:22:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T22:22:32.116584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253616,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721104,"statfs":{"total":773094113280,"available":772834410496,"internally_reserved":0,"allocated":4268032,"data_stored":2356824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.506468"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T22:22:25.154131+0000","last_change":"2024-04-26T22:21:11.615171+0000","last_active":"2024-04-26T22:22:25.154131+0000","last_peered":"2024-04-26T22:22:25.154131+0000","last_clean":"2024-04-26T22:22:25.154131+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:25.154131+0000","last_undegraded":"2024-04-26T22:22:25.154131+0000","last_fullsized":"2024-04-26T22:22:25.154131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:21:10.142644+0000","last_clean_scrub_stamp":"2024-04-26T22:21:10.142644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:24.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":737379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":737379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:33.418 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T22:21:10.142644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=21, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=22, tm_sec=27, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:22:33.418 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T22:22:44.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:22:44.668 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:22:53.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:22:53.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.565+0000 7f99f7200640 1 Processor -- start 2024-04-26T22:22:53.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.565+0000 7f99f7200640 1 -- start start 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f7200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 0x7f99f00b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f7200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f006e830 con 0x7f99f00b3c40 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f7200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f99f00b6400 con 0x7f99f00afc40 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99f00b0cb0 con 0x7f99f006e450 2024-04-26T22:22:53.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99e7400640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 0x7f99f00b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f5200640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f99f00b3c40 0x7f99f014bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.16:54456/0 (socket says 172.21.15.16:54456) 2024-04-26T22:22:53.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.16:56644/0 (socket says 172.21.15.16:56644) 2024-04-26T22:22:53.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99f5200640 1 -- 172.21.15.16:0/1815522022 learned_addr learned my addr 172.21.15.16:0/1815522022 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99ef400640 1 -- 172.21.15.16:0/1815522022 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156669076 0 0) 0x7f99f006e830 con 0x7f99f00b3c40 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 -- 172.21.15.16:0/1815522022 >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 msgr2=0x7f99f00b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 --2- 172.21.15.16:0/1815522022 >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 0x7f99f00b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 -- 172.21.15.16:0/1815522022 >> v1:172.21.15.195:6789/0 conn(0x7f99f00b3c40 legacy=0x7f99f014bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99efe00640 1 -- 172.21.15.16:0/1815522022 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f00b5db0 con 0x7f99f006e450 2024-04-26T22:22:53.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.569+0000 7f99e7400640 1 --2- 172.21.15.16:0/1815522022 >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 0x7f99f00b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:22:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99efe00640 1 --2- 172.21.15.16:0/1815522022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009d90 tx=0x7f99e001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d265c64665e4cc2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99ef400640 1 -- 172.21.15.16:0/1815522022 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e00b2070 con 0x7f99f006e450 2024-04-26T22:22:53.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99ef400640 1 -- 172.21.15.16:0/1815522022 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e00a5710 con 0x7f99f006e450 2024-04-26T22:22:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99ef400640 1 -- 172.21.15.16:0/1815522022 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5ae0 con 0x7f99f006e450 2024-04-26T22:22:53.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- 172.21.15.16:0/1815522022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 msgr2=0x7f99f00af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- 172.21.15.16:0/1815522022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99e0009d90 tx=0x7f99e001c850 comp rx=0 tx=0).stop 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- 172.21.15.16:0/1815522022 shutdown_connections 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- 172.21.15.16:0/1815522022 >> v2:172.21.15.195:3300/0 conn(0x7f99f00afc40 0x7f99f00b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- 172.21.15.16:0/1815522022 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f006e450 0x7f99f00af700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- 172.21.15.16:0/1815522022 >> 172.21.15.16:0/1815522022 conn(0x7f99f00b6620 msgr2=0x7f99f00b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- 172.21.15.16:0/1815522022 shutdown_connections 2024-04-26T22:22:53.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- 172.21.15.16:0/1815522022 wait complete. 2024-04-26T22:22:53.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 Processor -- start 2024-04-26T22:22:53.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- start start 2024-04-26T22:22:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f006e450 0x7f99f0148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f00b3c40 0x7f99f0147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f99f0155900 con 0x7f99f0141310 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f99f0155780 con 0x7f99f006e450 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.573+0000 7f99f7200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f99f0155a80 con 0x7f99f00b3c40 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35346/0 (socket says 172.21.15.16:35346) 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 -- 172.21.15.16:0/254846697 learned_addr learned my addr 172.21.15.16:0/254846697 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99e7400640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f00b3c40 0x7f99f0147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99efe00640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f006e450 0x7f99f0148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 -- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f00b3c40 msgr2=0x7f99f0147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f00b3c40 0x7f99f0147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 -- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f006e450 msgr2=0x7f99f0148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f006e450 0x7f99f0148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 -- 172.21.15.16:0/254846697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f0147ff0 con 0x7f99f0141310 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f5200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c480 tx=0x7f99e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8018070 con 0x7f99f0141310 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e80074e0 con 0x7f99f0141310 2024-04-26T22:22:53.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f01482a0 con 0x7f99f0141310 2024-04-26T22:22:53.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8004a30 con 0x7f99f0141310 2024-04-26T22:22:53.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f0147020 con 0x7f99f0141310 2024-04-26T22:22:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f0146b70 con 0x7f99f0141310 2024-04-26T22:22:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.577+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99e801b070 con 0x7f99f0141310 2024-04-26T22:22:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.581+0000 7f99ecc00640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 0x7f99cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.581+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f99e80858d0 con 0x7f99f0141310 2024-04-26T22:22:53.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.581+0000 7f99efe00640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 0x7f99cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.581+0000 7f99efe00640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 0x7f99cc06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f99e00af000 tx=0x7f99e00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.585+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f99e8055b30 con 0x7f99f0141310 2024-04-26T22:22:53.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.745+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 --> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99f0069530 con 0x7f99cc068380 2024-04-26T22:22:53.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.745+0000 7f99ecc00640 1 -- 172.21.15.16:0/254846697 <== mgr.4100 v2:172.21.15.195:6832/3987169006 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13354 (secure 0 0 0) 0x7f99f0069530 con 0x7f99cc068380 2024-04-26T22:22:53.749 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:53.749 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 msgr2=0x7f99cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 0x7f99cc06a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f99e00af000 tx=0x7f99e00a7070 comp rx=0 tx=0).stop 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 msgr2=0x7f99f0141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c480 tx=0x7f99e800c940 comp rx=0 tx=0).stop 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 shutdown_connections 2024-04-26T22:22:53.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f99cc068380 0x7f99cc06a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f0141310 0x7f99f0141790 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f00b3c40 0x7f99f0147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 --2- 172.21.15.16:0/254846697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f006e450 0x7f99f0148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 >> 172.21.15.16:0/254846697 conn(0x7f99f00b6620 msgr2=0x7f99f013e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 shutdown_connections 2024-04-26T22:22:53.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.749+0000 7f99f7200640 1 -- 172.21.15.16:0/254846697 wait complete. 2024-04-26T22:22:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-04-26T22:22:52.119760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253608,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721112,"statfs":{"total":773094113280,"available":772834418688,"internally_reserved":0,"allocated":4268032,"data_stored":2356824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001915"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":201,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T22:22:33.244099+0000","last_change":"2024-04-26T22:22:33.244140+0000","last_active":"2024-04-26T22:22:33.244099+0000","last_peered":"2024-04-26T22:22:33.244099+0000","last_clean":"2024-04-26T22:22:33.244099+0000","last_became_active":"2024-04-26T22:21:11.613868+0000","last_became_peered":"2024-04-26T22:21:11.613868+0000","last_unstale":"2024-04-26T22:22:33.244099+0000","last_undegraded":"2024-04-26T22:22:33.244099+0000","last_fullsized":"2024-04-26T22:22:33.244099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-26T22:22:33.244011+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-26T22:22:33.244011+0000","last_clean_scrub_stamp":"2024-04-26T22:22:33.244011+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:20.705774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":978944,"data_stored":737379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":147011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":978944,"data_stored":737379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:22:53.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T22:22:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 Processor -- start 2024-04-26T22:22:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 -- start start 2024-04-26T22:22:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe63406e410 0x7fe6340b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe6341465c0 0x7fe634149060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe63406e7f0 con 0x7fe63413eec0 2024-04-26T22:22:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe634070a40 con 0x7fe63406e410 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe63c200640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe634070760 con 0x7fe6341465c0 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe63406e410 0x7fe6340b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe63406e410 0x7fe6340b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35356/0 (socket says 172.21.15.16:35356) 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 -- 172.21.15.16:0/608551631 learned_addr learned my addr 172.21.15.16:0/608551631 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe638e00640 1 --2- 172.21.15.16:0/608551631 >> v2:172.21.15.195:3300/0 conn(0x7fe6341465c0 0x7fe634149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 -- 172.21.15.16:0/608551631 >> v2:172.21.15.195:3300/0 conn(0x7fe6341465c0 msgr2=0x7fe634149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 --2- 172.21.15.16:0/608551631 >> v2:172.21.15.195:3300/0 conn(0x7fe6341465c0 0x7fe634149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 -- 172.21.15.16:0/608551631 >> v1:172.21.15.195:6789/0 conn(0x7fe63413eec0 legacy=0x7fe63413f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.909+0000 7fe639800640 1 -- 172.21.15.16:0/608551631 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe634148860 con 0x7fe63406e410 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe639800640 1 --2- 172.21.15.16:0/608551631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe6340b30d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b7450 tx=0x7fe62801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc13691a8c686364 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe633e00640 1 -- 172.21.15.16:0/608551631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280b2070 con 0x7fe63406e410 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe633e00640 1 -- 172.21.15.16:0/608551631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6280a9070 con 0x7fe63406e410 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe633e00640 1 -- 172.21.15.16:0/608551631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280ad880 con 0x7fe63406e410 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- 172.21.15.16:0/608551631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 msgr2=0x7fe6340b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 --2- 172.21.15.16:0/608551631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe6340b30d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b7450 tx=0x7fe62801c490 comp rx=0 tx=0).stop 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- 172.21.15.16:0/608551631 shutdown_connections 2024-04-26T22:22:53.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 --2- 172.21.15.16:0/608551631 >> v2:172.21.15.195:3300/0 conn(0x7fe6341465c0 0x7fe634149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 --2- 172.21.15.16:0/608551631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe6340b30d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- 172.21.15.16:0/608551631 >> 172.21.15.16:0/608551631 conn(0x7fe6340b6590 msgr2=0x7fe6340b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- 172.21.15.16:0/608551631 shutdown_connections 2024-04-26T22:22:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- 172.21.15.16:0/608551631 wait complete. 2024-04-26T22:22:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 Processor -- start 2024-04-26T22:22:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.913+0000 7fe63c200640 1 -- start start 2024-04-26T22:22:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe63413eec0 0x7fe6341e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6341465c0 0x7fe634150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe6341505f0 con 0x7fe63406e410 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe634150470 con 0x7fe63413eec0 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe634150770 con 0x7fe6341465c0 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35372/0 (socket says 172.21.15.16:35372) 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 -- 172.21.15.16:0/1364926572 learned_addr learned my addr 172.21.15.16:0/1364926572 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe638e00640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe63413eec0 0x7fe6341e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63a200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6341465c0 0x7fe634150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 -- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6341465c0 msgr2=0x7fe634150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6341465c0 0x7fe634150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 -- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe63413eec0 msgr2=0x7fe6341e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe63413eec0 0x7fe6341e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 -- 172.21.15.16:0/1364926572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe634151ad0 con 0x7fe63406e410 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe639800640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b0040 tx=0x7fe62801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280bc020 con 0x7fe63406e410 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6280ade30 con 0x7fe63406e410 2024-04-26T22:22:53.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe634150a60 con 0x7fe63406e410 2024-04-26T22:22:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280b2040 con 0x7fe63406e410 2024-04-26T22:22:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6341e0f40 con 0x7fe63406e410 2024-04-26T22:22:53.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe634069530 con 0x7fe63406e410 2024-04-26T22:22:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.917+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe6280bf020 con 0x7fe63406e410 2024-04-26T22:22:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.921+0000 7fe631600640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 0x7fe61406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.921+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fe628120950 con 0x7fe63406e410 2024-04-26T22:22:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.921+0000 7fe638e00640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 0x7fe61406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.921+0000 7fe638e00640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 0x7fe61406a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe634142bd0 tx=0x7fe620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:53.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:53.925+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe6280c6030 con 0x7fe63406e410 2024-04-26T22:22:54.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.089+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe634152240 con 0x7fe63406e410 2024-04-26T22:22:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.093+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fe628016110 con 0x7fe63406e410 2024-04-26T22:22:54.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.093+0000 7fe631600640 1 -- 172.21.15.16:0/1364926572 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe6280a90c0 con 0x7fe63406e410 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 msgr2=0x7fe61406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 0x7fe61406a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe634142bd0 tx=0x7fe620008040 comp rx=0 tx=0).stop 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 msgr2=0x7fe634145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b0040 tx=0x7fe62801acd0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 shutdown_connections 2024-04-26T22:22:54.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7fe614068380 0x7fe61406a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6341465c0 0x7fe634150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe63413eec0 0x7fe6341e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 --2- 172.21.15.16:0/1364926572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe63406e410 0x7fe634145aa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 >> 172.21.15.16:0/1364926572 conn(0x7fe6340b6590 msgr2=0x7fe6341469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 shutdown_connections 2024-04-26T22:22:54.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.097+0000 7fe63c200640 1 -- 172.21.15.16:0/1364926572 wait complete. 2024-04-26T22:22:54.119 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:22:54.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:22:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 Processor -- start 2024-04-26T22:22:54.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 -- start start 2024-04-26T22:22:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f2428140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f242806e830 con 0x7f24280b0ac0 2024-04-26T22:22:54.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24280b5f00 con 0x7f242806e450 2024-04-26T22:22:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f24280b3310 con 0x7f24280b58d0 2024-04-26T22:22:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242d000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f24280b0ac0 0x7f2428150b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36674/0 (socket says 172.21.15.16:36674) 2024-04-26T22:22:54.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f242d000640 1 -- 172.21.15.16:0/451615599 learned_addr learned my addr 172.21.15.16:0/451615599 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f241fe00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f2428140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982678608 0 0) 0x7f242806e830 con 0x7f24280b0ac0 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.257+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f240c003530 con 0x7f24280b0ac0 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327776530 0 0) 0x7f24280b5f00 con 0x7f242806e450 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f242806e830 con 0x7f242806e450 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1212510380 0 0) 0x7f240c003530 con 0x7f24280b0ac0 2024-04-26T22:22:54.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 msgr2=0x7f2428140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f2428140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 >> v1:172.21.15.195:6789/0 conn(0x7f242806e450 legacy=0x7f24280b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24280b61e0 con 0x7f24280b0ac0 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2484304163 0 0) 0x7f2420001a00 con 0x7f24280b0ac0 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 >> v1:172.21.15.16:6789/0 conn(0x7f24280b0ac0 legacy=0x7f2428150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f240c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f240c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f240c004d50 0x7f240c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24280b3310 con 0x7f240c003b80 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f240c00bad0 con 0x7f240c004d50 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f240c00bcd0 con 0x7f24280b58d0 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f240c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f241fe00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f240c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f242d000640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f240c004d50 0x7f240c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 -- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 msgr2=0x7f240c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:54.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24280b58d0 0x7f240c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 -- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f240c004d50 msgr2=0x7f240c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:22:54.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f240c004d50 0x7f240c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 -- 172.21.15.16:0/451615599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c003530 con 0x7f240c003b80 2024-04-26T22:22:54.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.261+0000 7f2427e00640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f240c003f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f24180018d0 tx=0x7f241801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228046169cf26cb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:54.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418001520 con 0x7f240c003b80 2024-04-26T22:22:54.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f24180050d0 con 0x7f240c003b80 2024-04-26T22:22:54.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427400640 1 -- 172.21.15.16:0/451615599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180054c0 con 0x7f240c003b80 2024-04-26T22:22:54.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- 172.21.15.16:0/451615599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 msgr2=0x7f240c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 --2- 172.21.15.16:0/451615599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f240c003f80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f24180018d0 tx=0x7f241801c580 comp rx=0 tx=0).stop 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242d000640 1 -- 172.21.15.16:0/451615599 reap_dead start 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- 172.21.15.16:0/451615599 shutdown_connections 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- 172.21.15.16:0/451615599 >> 172.21.15.16:0/451615599 conn(0x7f24280b6620 msgr2=0x7f24280b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- 172.21.15.16:0/451615599 shutdown_connections 2024-04-26T22:22:54.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- 172.21.15.16:0/451615599 wait complete. 2024-04-26T22:22:54.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 Processor -- start 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- start start 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2428151680 0x7f242814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242814fa80 0x7f242813a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2428152600 con 0x7f240c003b80 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f2428152480 con 0x7f242814fa80 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242f000640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f2428152780 con 0x7f2428151680 2024-04-26T22:22:54.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35390/0 (socket says 172.21.15.16:35390) 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427e00640 1 -- 172.21.15.16:0/1554347893 learned_addr learned my addr 172.21.15.16:0/1554347893 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f241fe00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2428151680 0x7f242814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f242d000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242814fa80 0x7f242813a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427e00640 1 -- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2428151680 msgr2=0x7f242814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.265+0000 7f2427e00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2428151680 0x7f242814f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2427e00640 1 -- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242814fa80 msgr2=0x7f242813a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2427e00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242814fa80 0x7f242813a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2427e00640 1 -- 172.21.15.16:0/1554347893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242813d760 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2427e00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2418000c10 tx=0x7f240c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180bf070 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2418003810 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418003be0 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242814ff10 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2428073d90 con 0x7f240c003b80 2024-04-26T22:22:54.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2428073ba0 con 0x7f240c003b80 2024-04-26T22:22:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f24180c2070 con 0x7f240c003b80 2024-04-26T22:22:54.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 0x7f240406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:22:54.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2418120070 con 0x7f240c003b80 2024-04-26T22:22:54.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.269+0000 7f241fe00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 0x7f240406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:22:54.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.273+0000 7f241fe00640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 0x7f240406a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24280b2f80 tx=0x7f2410009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:22:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.273+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2418016290 con 0x7f240c003b80 2024-04-26T22:22:54.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2428069530 con 0x7f240c003b80 2024-04-26T22:22:54.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f2424c00640 1 -- 172.21.15.16:0/1554347893 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+2213 (secure 0 0 0) 0x7f24180f01b0 con 0x7f240c003b80 2024-04-26T22:22:54.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T22:22:54.479 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4715,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/264784279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":264784279},{"type":"v1","addr":"172.21.15.195:6835","nonce":264784279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/40900418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":40900418},{"type":"v1","addr":"172.21.15.16:6833","nonce":40900418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-26T22:22:54.479 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-04-26T22:22:54.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 msgr2=0x7f240406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 0x7f240406a870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24280b2f80 tx=0x7f2410009190 comp rx=0 tx=0).stop 2024-04-26T22:22:54.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 msgr2=0x7f24280b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2418000c10 tx=0x7f240c005840 comp rx=0 tx=0).stop 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 shutdown_connections 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:6832/3987169006,v1:172.21.15.195:6833/3987169006] conn(0x7f24040683b0 0x7f240406a870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f242814fa80 0x7f242813a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2428151680 0x7f242814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 --2- 172.21.15.16:0/1554347893 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f240c003b80 0x7f24280b24f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 >> 172.21.15.16:0/1554347893 conn(0x7f24280b6620 msgr2=0x7f242806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:22:54.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 shutdown_connections 2024-04-26T22:22:54.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T22:22:54.477+0000 7f242f000640 1 -- 172.21.15.16:0/1554347893 wait complete. 2024-04-26T22:22:54.499 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T22:22:54.499 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T22:22:54.499 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:22:54.500 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:22:54.512 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:22:54.513 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:22:54.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:22:54.528 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:22:54.528 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T22:22:54.528 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T22:22:54.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:22:59.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T22:23:00.630 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T22:23:00.631 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T22:23:00.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:00.690 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T22:23:00.691 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T22:23:00.691 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:00.787 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T22:23:00.787 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T22:23:00.787 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:05.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T22:23:05.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T22:23:06.890 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T22:23:06.890 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T22:23:06.890 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:06.981 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T22:23:06.982 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T22:23:06.982 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:11.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-26T22:23:11.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T22:23:13.083 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T22:23:13.084 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T22:23:13.084 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.182 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T22:23:13.182 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T22:23:13.182 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.274 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T22:23:13.274 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T22:23:13.274 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T22:23:13.275 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.330 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T22:23:13.331 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T22:23:13.331 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.389 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T22:23:13.389 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T22:23:13.389 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T22:23:13.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.408 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T22:23:13.408 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T22:23:13.408 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.425 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T22:23:13.425 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T22:23:13.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:23:13.485 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T22:23:13.485 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T22:23:13.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-26T22:23:13.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:23:13.520 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T22:23:13.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:23:13.741 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T22:23:13.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:23:13.912 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T22:23:14.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:23:14.088 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T22:23:14.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:23:14.245 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T22:23:14.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:23:14.437 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T22:23:14.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:23:14.643 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T22:23:14.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:23:14.906 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T22:23:14.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:14.985 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:15.092 INFO:tasks.ceph:Archiving mon data... 2024-04-26T22:23:15.093 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/data/mon.a.tgz 2024-04-26T22:23:15.093 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T22:23:15.102 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.NF1mJgso9M 2024-04-26T22:23:15.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NF1mJgso9M 2024-04-26T22:23:15.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.NF1mJgso9M 2024-04-26T22:23:15.298 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.NF1mJgso9M is 282KB 2024-04-26T22:23:15.359 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.NF1mJgso9M 2024-04-26T22:23:15.368 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/data/mon.b.tgz 2024-04-26T22:23:15.368 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-26T22:23:15.376 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.2fGFSSH5yJ 2024-04-26T22:23:15.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2fGFSSH5yJ 2024-04-26T22:23:15.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.2fGFSSH5yJ 2024-04-26T22:23:15.597 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.2fGFSSH5yJ is 378KB 2024-04-26T22:23:15.618 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.2fGFSSH5yJ 2024-04-26T22:23:15.626 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/data/mon.c.tgz 2024-04-26T22:23:15.627 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-26T22:23:15.676 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.RHVM7fjFzm 2024-04-26T22:23:15.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RHVM7fjFzm 2024-04-26T22:23:15.803 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.RHVM7fjFzm 2024-04-26T22:23:15.881 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.RHVM7fjFzm is 378KB 2024-04-26T22:23:15.943 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.RHVM7fjFzm 2024-04-26T22:23:15.951 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T22:23:15.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:23:15.954 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:23:16.025 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:23:16.060 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:23:16.060 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T22:23:16.062 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi016/crash 2024-04-26T22:23:16.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:23:16.089 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi195/crash 2024-04-26T22:23:16.090 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:23:16.118 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T22:23:16.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:16.135 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:16.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:16.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:23:16.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-26T22:23:16.271 INFO:tasks.ceph:Compressing logs... 2024-04-26T22:23:16.271 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:23:16.275 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:23:16.301 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34256.log 2024-04-26T22:23:16.302 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32477.log 2024-04-26T22:23:16.303 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34770.log 2024-04-26T22:23:16.303 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34256.log.gz 2024-04-26T22:23:16.304 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-04-26T22:23:16.304 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32477.log.gz 2024-04-26T22:23:16.305 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35923.log 2024-04-26T22:23:16.305 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34770.log.gz 2024-04-26T22:23:16.306 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-04-26T22:23:16.306 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-04-26T22:23:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32671.log 2024-04-26T22:23:16.307 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35923.log.gz 2024-04-26T22:23:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34099.log 2024-04-26T22:23:16.308 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-04-26T22:23:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34014.log 2024-04-26T22:23:16.309 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32671.log.gz 2024-04-26T22:23:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-04-26T22:23:16.309 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34099.log.gz 2024-04-26T22:23:16.310 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35581.log 2024-04-26T22:23:16.310 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34014.log.gz 2024-04-26T22:23:16.311 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T22:23:16.311 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-04-26T22:23:16.312 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33596.log 2024-04-26T22:23:16.312 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35581.log.gz 2024-04-26T22:23:16.312 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35335.log 2024-04-26T22:23:16.314 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-04-26T22:23:16.314 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33596.log.gz 2024-04-26T22:23:16.314 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35741.log 2024-04-26T22:23:16.315 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35335.log.gz 2024-04-26T22:23:16.316 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27420.log 2024-04-26T22:23:16.316 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-04-26T22:23:16.316 INFO:teuthology.orchestra.run.smithi016.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T22:23:16.316 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32892.log 2024-04-26T22:23:16.318 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35741.log.gz 2024-04-26T22:23:16.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33832.log 2024-04-26T22:23:16.318 INFO:teuthology.orchestra.run.smithi016.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.27420.log.gz 2024-04-26T22:23:16.318 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34495.log 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32892.log.gz 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32685.log 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33832.log.gz 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34495.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34495.log.gz 2024-04-26T22:23:16.320 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-04-26T22:23:16.321 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32685.log.gz 2024-04-26T22:23:16.321 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-04-26T22:23:16.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-04-26T22:23:16.323 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-04-26T22:23:16.323 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-04-26T22:23:16.323 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-04-26T22:23:16.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-04-26T22:23:16.324 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-04-26T22:23:16.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27532.log 2024-04-26T22:23:16.325 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2024-04-26T22:23:16.325 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2024-04-26T22:23:16.325 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-04-26T22:23:16.326 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32469.log 2024-04-26T22:23:16.326 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27532.log.gz 2024-04-26T22:23:16.327 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2024-04-26T22:23:16.327 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz 2024-04-26T22:23:16.328 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33256.log 2024-04-26T22:23:16.328 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32469.log.gz 2024-04-26T22:23:16.329 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33492.log 2024-04-26T22:23:16.329 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2024-04-26T22:23:16.330 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34625.log 2024-04-26T22:23:16.330 INFO:teuthology.orchestra.run.smithi016.stderr: 91.1%/var/log/ceph/ceph-client.admin.33492.log: -- replaced with /var/log/ceph/ceph-client.admin.33256.log.gz 2024-04-26T22:23:16.331 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-04-26T22:23:16.331 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33492.log.gz 2024-04-26T22:23:16.332 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-04-26T22:23:16.332 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34625.log.gz 2024-04-26T22:23:16.332 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph.tmp-client.admin.22656.log -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-04-26T22:23:16.333 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T22:23:16.333 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34979.log 2024-04-26T22:23:16.334 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-04-26T22:23:16.334 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.22656.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.22656.log.gz 2024-04-26T22:23:16.334 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35437.log 2024-04-26T22:23:16.335 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34547.log 2024-04-26T22:23:16.336 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34979.log.gz 2024-04-26T22:23:16.336 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35309.log 2024-04-26T22:23:16.337 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35437.log.gz 2024-04-26T22:23:16.337 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33884.log 2024-04-26T22:23:16.337 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34547.log.gz 2024-04-26T22:23:16.338 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33936.log 2024-04-26T22:23:16.338 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35309.log.gz 2024-04-26T22:23:16.339 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-04-26T22:23:16.339 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-04-26T22:23:16.340 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-04-26T22:23:16.340 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33936.log.gz 2024-04-26T22:23:16.340 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33988.log 2024-04-26T22:23:16.341 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27699.log 2024-04-26T22:23:16.342 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-04-26T22:23:16.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32086.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-04-26T22:23:16.342 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35819.log 2024-04-26T22:23:16.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33988.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T22:23:16.345 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33988.log.gz 2024-04-26T22:23:16.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-04-26T22:23:16.345 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35819.log.gz 2024-04-26T22:23:16.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-04-26T22:23:16.346 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T22:23:16.346 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27699.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T22:23:16.346 INFO:teuthology.orchestra.run.smithi195.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27699.log.gz 2024-04-26T22:23:16.346 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27747.log 2024-04-26T22:23:16.347 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T22:23:16.347 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27723.log 2024-04-26T22:23:16.347 INFO:teuthology.orchestra.run.smithi195.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27747.log.gz 2024-04-26T22:23:16.347 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T22:23:16.349 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27723.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T22:23:16.349 INFO:teuthology.orchestra.run.smithi195.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27723.log.gz 2024-04-26T22:23:16.349 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27795.log 2024-04-26T22:23:16.349 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27651.log 2024-04-26T22:23:16.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34230.log 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32944.log 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32259.log: /var/log/ceph/ceph-client.admin.34230.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34230.log.gz 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32060.log 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32944.log.gz 2024-04-26T22:23:16.352 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-04-26T22:23:16.353 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-04-26T22:23:16.353 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32060.log.gz 2024-04-26T22:23:16.353 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-04-26T22:23:16.353 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-04-26T22:23:16.356 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27795.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T22:23:16.356 INFO:teuthology.orchestra.run.smithi195.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27795.log.gz 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27651.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27651.log.gz 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27771.log 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27771.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27771.log.gz 2024-04-26T22:23:16.357 INFO:teuthology.orchestra.run.smithi195.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5/var/log/ceph/ceph-client.admin.36526.log: --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36266.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34670.log 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-04-26T22:23:16.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35633.log 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34670.log.gz 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32866.log 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35361.log 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35633.log.gz 2024-04-26T22:23:16.360 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31809.log 2024-04-26T22:23:16.363 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32866.log: /var/log/ceph/ceph-client.admin.35361.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32866.log.gz 2024-04-26T22:23:16.363 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34521.log 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35361.log.gz 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31809.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.31809.log.gz 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33648.log 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36604.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34521.log.gz 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31757.log 2024-04-26T22:23:16.364 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mds.b.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27819.log 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27819.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27819.log.gz 2024-04-26T22:23:16.365 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-26T22:23:16.367 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.27675.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-26T22:23:16.368 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33648.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33648.log.gz 2024-04-26T22:23:16.368 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.36500.log 2024-04-26T22:23:16.368 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34599.log 2024-04-26T22:23:16.368 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31757.log.gz 2024-04-26T22:23:16.368 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34417.log 2024-04-26T22:23:16.369 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36500.log: /var/log/ceph/ceph-client.admin.34599.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-04-26T22:23:16.369 INFO:teuthology.orchestra.run.smithi016.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34599.log.gz -5 2024-04-26T22:23:16.369 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32679.log 2024-04-26T22:23:16.370 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.34417.log: -- /var/log/ceph/ceph-client.admin.35793.log 2024-04-26T22:23:16.370 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32679.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34417.log.gz 2024-04-26T22:23:16.370 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35205.log 2024-04-26T22:23:16.370 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32679.log.gz 2024-04-26T22:23:16.371 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-04-26T22:23:16.371 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35793.log.gz 2024-04-26T22:23:16.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35205.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.35205.log.gz 2024-04-26T22:23:16.372 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T22:23:16.373 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-04-26T22:23:16.373 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-04-26T22:23:16.374 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35493.log 2024-04-26T22:23:16.375 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-04-26T22:23:16.375 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-04-26T22:23:16.376 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.35493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33074.log 2024-04-26T22:23:16.378 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-04-26T22:23:16.378 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-04-26T22:23:16.379 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-04-26T22:23:16.379 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33074.log.gz 2024-04-26T22:23:16.379 INFO:teuthology.orchestra.run.smithi016.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.35493.log.gz 2024-04-26T22:23:16.380 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35550.log 2024-04-26T22:23:16.381 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-04-26T22:23:16.381 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-04-26T22:23:16.381 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-04-26T22:23:16.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31705.log 2024-04-26T22:23:16.383 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35550.log.gz 2024-04-26T22:23:16.383 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-04-26T22:23:16.384 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-04-26T22:23:16.384 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35685.log 2024-04-26T22:23:16.385 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31705.log.gz 2024-04-26T22:23:16.386 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33726.log 2024-04-26T22:23:16.386 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-04-26T22:23:16.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36682.log 2024-04-26T22:23:16.387 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35685.log.gz 2024-04-26T22:23:16.388 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27639.log 2024-04-26T22:23:16.388 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33726.log.gz 2024-04-26T22:23:16.389 INFO:teuthology.orchestra.run.smithi195.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T22:23:16.389 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35087.log 2024-04-26T22:23:16.390 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36682.log.gz 2024-04-26T22:23:16.391 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2024-04-26T22:23:16.391 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27639.log.gz 2024-04-26T22:23:16.391 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-04-26T22:23:16.392 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35087.log.gz 2024-04-26T22:23:16.393 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33804.log 2024-04-26T22:23:16.393 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2024-04-26T22:23:16.394 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-04-26T22:23:16.394 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-04-26T22:23:16.395 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33804.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T22:23:16.395 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33804.log.gz 2024-04-26T22:23:16.396 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32264.log 2024-04-26T22:23:16.397 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-04-26T22:23:16.397 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-04-26T22:23:16.399 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36072.log 2024-04-26T22:23:16.399 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32264.log.gz 2024-04-26T22:23:16.400 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-04-26T22:23:16.400 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gz 2024-04-26T22:23:16.402 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36072.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-04-26T22:23:16.402 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36448.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-04-26T22:23:16.403 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33778.log 2024-04-26T22:23:16.404 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-04-26T22:23:16.405 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35659.log 2024-04-26T22:23:16.405 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33778.log.gz 2024-04-26T22:23:16.407 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34177.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-04-26T22:23:16.407 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35659.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35659.log.gz 2024-04-26T22:23:16.408 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-04-26T22:23:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35257.log 2024-04-26T22:23:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32672.log 2024-04-26T22:23:16.411 INFO:teuthology.orchestra.run.smithi016.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-04-26T22:23:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35257.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35257.log.gz 2024-04-26T22:23:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32672.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32672.log.gz 2024-04-26T22:23:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33230.log 2024-04-26T22:23:16.414 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-04-26T22:23:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2024-04-26T22:23:16.416 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33230.log.gz 2024-04-26T22:23:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32266.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-04-26T22:23:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33152.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-04-26T22:23:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32683.log 2024-04-26T22:23:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35031.log 2024-04-26T22:23:16.421 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-04-26T22:23:16.422 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-04-26T22:23:16.423 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35031.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35031.log.gz 2024-04-26T22:23:16.424 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34725.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gz 2024-04-26T22:23:16.424 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T22:23:16.425 INFO:teuthology.orchestra.run.smithi016.stderr:gzip 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T22:23:16.425 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34151.log 2024-04-26T22:23:16.425 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32658.log 2024-04-26T22:23:16.426 INFO:teuthology.orchestra.run.smithi195.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T22:23:16.426 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-04-26T22:23:16.427 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34151.log.gz 2024-04-26T22:23:16.427 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-04-26T22:23:16.427 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32658.log.gz 2024-04-26T22:23:16.428 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31731.log 2024-04-26T22:23:16.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-04-26T22:23:16.429 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32270.log 2024-04-26T22:23:16.430 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-04-26T22:23:16.430 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35715.log 2024-04-26T22:23:16.431 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31731.log.gz 2024-04-26T22:23:16.432 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34927.log 2024-04-26T22:23:16.432 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32270.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32270.log.gz 2024-04-26T22:23:16.432 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-04-26T22:23:16.433 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35715.log.gz 2024-04-26T22:23:16.433 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33544.log 2024-04-26T22:23:16.433 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34927.log.gz 2024-04-26T22:23:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35897.log 2024-04-26T22:23:16.434 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-04-26T22:23:16.435 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33544.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T22:23:16.435 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33544.log.gz 2024-04-26T22:23:16.436 INFO:teuthology.orchestra.run.smithi195.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T22:23:16.436 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33440.log 2024-04-26T22:23:16.437 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35897.log.gz 2024-04-26T22:23:16.437 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32112.log 2024-04-26T22:23:16.438 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.33440.log: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:23:16.438 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32970.log 2024-04-26T22:23:16.439 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.33440.log.gz 2024-04-26T22:23:16.439 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-04-26T22:23:16.439 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32112.log.gz 2024-04-26T22:23:16.441 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2024-04-26T22:23:16.441 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32970.log.gz 2024-04-26T22:23:16.441 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34953.log 2024-04-26T22:23:16.442 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-04-26T22:23:16.442 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2024-04-26T22:23:16.442 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gz 2024-04-26T22:23:16.443 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35607.log 2024-04-26T22:23:16.444 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34953.log.gz 2024-04-26T22:23:16.444 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34443.log 2024-04-26T22:23:16.445 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2024-04-26T22:23:16.445 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34875.log 2024-04-26T22:23:16.446 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35607.log.gz 2024-04-26T22:23:16.446 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-04-26T22:23:16.447 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34443.log.gz 2024-04-26T22:23:16.447 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35059.log 2024-04-26T22:23:16.448 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34875.log.gz 2024-04-26T22:23:16.448 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33048.log 2024-04-26T22:23:16.448 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-04-26T22:23:16.449 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34073.log 2024-04-26T22:23:16.449 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35059.log.gz 2024-04-26T22:23:16.450 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32252.log 2024-04-26T22:23:16.450 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33048.log.gz 2024-04-26T22:23:16.451 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-04-26T22:23:16.451 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34073.log.gz 2024-04-26T22:23:16.452 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36734.log 2024-04-26T22:23:16.452 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32252.log.gz 2024-04-26T22:23:16.453 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31659.log 2024-04-26T22:23:16.453 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gz 2024-04-26T22:23:16.454 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-04-26T22:23:16.454 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36734.log.gz 2024-04-26T22:23:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32478.log 2024-04-26T22:23:16.455 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31659.log.gz 2024-04-26T22:23:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35231.log 2024-04-26T22:23:16.456 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-04-26T22:23:16.457 INFO:teuthology.orchestra.run.smithi195.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T22:23:16.457 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-04-26T22:23:16.458 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32478.log.gz 2024-04-26T22:23:16.458 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32996.log 2024-04-26T22:23:16.458 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35231.log.gz 2024-04-26T22:23:16.459 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-04-26T22:23:16.459 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-04-26T22:23:16.460 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33910.log 2024-04-26T22:23:16.460 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32996.log.gz 2024-04-26T22:23:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33700.log 2024-04-26T22:23:16.461 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-04-26T22:23:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34365.log 2024-04-26T22:23:16.462 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33910.log.gz 2024-04-26T22:23:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32190.log 2024-04-26T22:23:16.462 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33700.log.gz 2024-04-26T22:23:16.463 INFO:teuthology.orchestra.run.smithi195.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T22:23:16.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35005.log 2024-04-26T22:23:16.464 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34365.log.gz 2024-04-26T22:23:16.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34125.log 2024-04-26T22:23:16.465 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32190.log.gz 2024-04-26T22:23:16.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35283.log 2024-04-26T22:23:16.466 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35005.log.gz 2024-04-26T22:23:16.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32034.log 2024-04-26T22:23:16.466 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34125.log.gz 2024-04-26T22:23:16.467 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35283.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T22:23:16.468 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35283.log.gz 2024-04-26T22:23:16.468 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-04-26T22:23:16.468 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32034.log.gz 2024-04-26T22:23:16.469 INFO:teuthology.orchestra.run.smithi195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T22:23:16.469 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32255.log 2024-04-26T22:23:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36240.log 2024-04-26T22:23:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36760.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:23:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32255.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz 2024-04-26T22:23:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T22:23:16.472 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32255.log.gz 2024-04-26T22:23:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31861.log 2024-04-26T22:23:16.472 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36240.log.gz 2024-04-26T22:23:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35767.log 2024-04-26T22:23:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32269.log 2024-04-26T22:23:16.474 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31861.log.gz 2024-04-26T22:23:16.475 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-04-26T22:23:16.475 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35767.log.gz 2024-04-26T22:23:16.476 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.32269.log: /var/log/ceph/ceph-client.admin.31783.log 2024-04-26T22:23:16.476 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32269.log.gz 2024-04-26T22:23:16.477 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-04-26T22:23:16.477 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-04-26T22:23:16.478 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-04-26T22:23:16.478 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31783.log.gz 2024-04-26T22:23:16.479 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32476.log 2024-04-26T22:23:16.479 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36162.log: /var/log/ceph/ceph-client.admin.33178.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-04-26T22:23:16.480 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33570.log 2024-04-26T22:23:16.480 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-04-26T22:23:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-04-26T22:23:16.482 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32476.log.gz 2024-04-26T22:23:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32138.log 2024-04-26T22:23:16.483 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33570.log.gz 2024-04-26T22:23:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-04-26T22:23:16.484 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-04-26T22:23:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32686.log 2024-04-26T22:23:16.485 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32138.log.gz 2024-04-26T22:23:16.485 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34391.log 2024-04-26T22:23:16.486 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34901.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-04-26T22:23:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32918.log 2024-04-26T22:23:16.487 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32686.log.gz 2024-04-26T22:23:16.487 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34308.log 2024-04-26T22:23:16.488 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34391.log.gz 2024-04-26T22:23:16.489 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33518.log 2024-04-26T22:23:16.489 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32918.log.gz 2024-04-26T22:23:16.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34339.log 2024-04-26T22:23:16.490 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34308.log.gz 2024-04-26T22:23:16.491 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33752.log 2024-04-26T22:23:16.491 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33518.log.gz 2024-04-26T22:23:16.492 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35871.log 2024-04-26T22:23:16.492 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34339.log.gz 2024-04-26T22:23:16.493 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35845.log 2024-04-26T22:23:16.494 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33752.log.gz 2024-04-26T22:23:16.494 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35871.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.35871.log.gz --verbose 2024-04-26T22:23:16.495 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.32216.log 2024-04-26T22:23:16.495 INFO:teuthology.orchestra.run.smithi195.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T22:23:16.496 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32164.log 2024-04-26T22:23:16.496 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35845.log.gz 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m0.178s 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m0.657s 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.097s 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31952.log 2024-04-26T22:23:16.497 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gz 2024-04-26T22:23:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36370.log 2024-04-26T22:23:16.499 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32164.log.gz 2024-04-26T22:23:16.499 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-04-26T22:23:16.499 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31952.log.gz 2024-04-26T22:23:16.500 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-04-26T22:23:16.500 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36370.log.gz 2024-04-26T22:23:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-04-26T22:23:16.501 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-04-26T22:23:16.502 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-04-26T22:23:16.502 INFO:teuthology.orchestra.run.smithi016.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2024-04-26T22:23:16.503 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-04-26T22:23:16.503 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-04-26T22:23:16.504 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36710.log 2024-04-26T22:23:16.505 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-04-26T22:23:16.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-04-26T22:23:16.506 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-04-26T22:23:16.506 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-04-26T22:23:16.507 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2024-04-26T22:23:16.507 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36630.log 2024-04-26T22:23:16.508 INFO:teuthology.orchestra.run.smithi016.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T22:23:16.508 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-04-26T22:23:16.509 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-04-26T22:23:16.509 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-04-26T22:23:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31978.log 2024-04-26T22:23:16.510 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36630.log.gz 2024-04-26T22:23:16.510 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34849.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-04-26T22:23:16.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31978.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31978.log.gz 2024-04-26T22:23:16.524 INFO:teuthology.orchestra.run.smithi016.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T22:23:16.528 INFO:teuthology.orchestra.run.smithi016.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T22:23:16.533 INFO:teuthology.orchestra.run.smithi016.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T22:23:16.535 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T22:23:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m0.257s 2024-04-26T22:23:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m0.925s 2024-04-26T22:23:16.536 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.310s 2024-04-26T22:23:16.537 INFO:tasks.ceph:Archiving logs... 2024-04-26T22:23:16.537 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi016/log 2024-04-26T22:23:16.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:23:16.849 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi195/log 2024-04-26T22:23:16.850 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:23:16.949 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T22:23:16.971 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T22:23:16.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:23:16.975 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:23:17.045 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T22:23:17.056 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T22:23:17.056 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:23:17.059 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:23:17.070 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T22:23:17.071 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T22:23:17.071 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 15 64 77 0.076 -4.529 2.163 2024-04-26T22:23:17.071 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 63.231.80.2 3 u 19 64 77 0.125 +0.373 3.206 2024-04-26T22:23:17.071 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 77 0.079 +2.204 2.348 2024-04-26T22:23:17.071 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:23:17.073 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T22:23:17.073 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-04-26T22:23:17.074 INFO:teuthology.orchestra.run.smithi195.stdout:+hv01.front.sepi 67.205.162.81 3 u 21 64 77 0.091 -0.624 1.850 2024-04-26T22:23:17.074 INFO:teuthology.orchestra.run.smithi195.stdout:*hv02.front.sepi 63.231.80.2 3 u 13 64 77 0.086 -0.804 0.828 2024-04-26T22:23:17.074 INFO:teuthology.orchestra.run.smithi195.stdout:+hv03.front.sepi 74.6.168.72 3 u 17 64 77 0.085 +2.126 0.819 2024-04-26T22:23:17.074 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T22:23:17.075 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T22:23:17.084 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T22:23:17.085 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T22:23:17.093 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T22:23:17.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T22:23:17.111 INFO:teuthology.task.internal:Duration was 865.687366 seconds 2024-04-26T22:23:17.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T22:23:17.119 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T22:23:17.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:23:17.123 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:23:17.221 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T22:23:17.222 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T22:23:17.222 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:23:17.242 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T22:23:17.242 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:23:17.261 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T22:23:17.261 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:23:17.291 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:23:17.344 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T22:23:17.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:23:17.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:23:17.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T22:23:17.460 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T22:23:17.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:23:17.481 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:23:17.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T22:23:17.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:23:17.533 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:23:17.548 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-26T22:23:17.561 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-26T22:23:17.779 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:23:17.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:23:17.786 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:23:17.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:23:17.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T22:23:17.839 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T22:23:17.840 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi016 2024-04-26T22:23:17.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:23:17.868 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253/remote/smithi195 2024-04-26T22:23:17.868 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:23:17.894 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T22:23:17.895 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:23:17.907 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:23:17.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T22:23:17.952 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T22:23:17.953 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T22:23:17.962 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T22:23:17.963 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:23:17.966 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:23:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:23 /home/ubuntu/cephtest 2024-04-26T22:23:17.992 INFO:teuthology.orchestra.run.smithi195.stdout: 658124 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:23 /home/ubuntu/cephtest 2024-04-26T22:23:17.994 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T22:23:18.005 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T22:23:18.025 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T22:23:18.052 DEBUG:teuthology.nuke:shortname: smithi016 2024-04-26T22:23:18.052 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:23:18.074 DEBUG:teuthology.nuke:shortname: smithi195 2024-04-26T22:23:18.074 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:23:18.078 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:59:48.280384', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdviHqzHs+vdNmyuFyasvDD/rfZLPuatmIaZogHh2SLOrwEmwQn3LVJ05oVH6D3A/yM6NjqgO+QbuA4ZB220rg='} 2024-04-26T22:23:18.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675253', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:59:48.282430', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMB1S6+scQRZqt3NL0nI7n8ZTuZbylBMEgqqac11Hxg/27waG8oxqCdTGYejbKyIa/zH124AfkBmcYeZnSh5LIE='} 2024-04-26T22:23:18.127 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-26T22:23:18.128 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T22:23:18.166 INFO:teuthology.orchestra.console.smithi195:Power off 2024-04-26T22:23:18.166 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T22:23:18.174 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-26T22:23:18.174 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:18.187 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-04-26T22:23:18.188 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:18.198 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-26T22:23:18.212 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-26T22:23:22.199 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:22.212 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:22.311 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-26T22:23:22.322 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-26T22:23:26.312 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:26.323 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:26.421 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-26T22:23:26.433 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-26T22:23:26.534 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-04-26T22:23:30.426 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:23:30.537 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-26T22:23:30.638 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-26T22:23:30.743 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} duration: 865.6873662471771 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=856dc7b9ecc44733bc9fc294b8def62f status: fail success: false 2024-04-26T22:23:30.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T22:23:30.853 INFO:teuthology.run:FAIL